hadoop - When runtime modifications are written to Edits log file in Name Node, is the Edits Log file getting updated on RAM or Local Disk -
when run-time modifications written edits log file in name node, edits log file getting updated on ram or local disk
the answer both. first on disk , on ram.
to start with, edits log logical entity, whereas in real case can many files spread across (called segments), naming convention similar "edits_xxxxxxxxxxx", each of represents particular action (called transaction) done in hdfs such append file, delete file, etc.,
edits file/segment updated first (on disk) , in-memory (in ram) metadata of nn updated. thereafter in-memory data served needy clients.
courtesy: hadoop - definitive guide.
Comments
Post a Comment