Metadata About Metadata--An Example Analysis: Page 3 - EnterpriseStorageForum.com

Metadata About Metadata--An Example Analysis - Page 3

Then the analysis focused on analyzing mtime age. That is, the difference in time from when I ran mdpostp and when I gathered the file system data. The first output is a summary of the overall statistics.

  • Average mtime age in days: 433.871 days
  • Oldest mtime age file in days: 3,131.168 days
  • Yonugest mtime age file in days: 1.665 days
  • Standard deviation mtime age in days: 112.1403 days

The newest file is only 1.665 days old, and the oldest is almost 8.57 years old.

The next section of the output counts the number of files in certain time intervals. For example, it will count the number of files that are 1 day or younger based on mtime. The "interval" output for the example is the following:

[   0-   1 days]:    43  (  0.08%)  (  0.08% cumulative)
[   1-   2 days]:     0  (  0.00%)  (  0.08% cumulative)
[   2-   4 days]:    81  (  0.15%)  (  0.23% cumulative)
[   4-   7 days]:    43  (  0.08%)  (  0.31% cumulative)
[   7-  14 days]:    30  (  0.06%)  (  0.36% cumulative)
[  14-  28 days]:     9  (  0.02%)  (  0.38% cumulative)
[  28-  56 days]:  2854  (  5.28%)  (  5.66% cumulative)
[  56- 112 days]:     8  (  0.01%)  (  5.68% cumulative)
[ 112- 168 days]:   450  (  0.83%)  (  6.51% cumulative)
[ 168- 252 days]:  1449  (  2.68%)  (  9.19% cumulative)
[ 252- 365 days]:   269  (  0.50%)  (  9.69% cumulative)
[ 365- 504 days]: 48754  ( 90.23%)  ( 99.91% cumulative)
[ 504- 730 days]:    12  (  0.02%)  ( 99.94% cumulative)
[ 730-1095 days]:    29  (  0.05%)  ( 99.99% cumulative)
[1095-1460 days]:     0  (  0.00%)  ( 99.99% cumulative)
[1460-1825 days]:     0  (  0.00%)  ( 99.99% cumulative)
[1825-2190 days]:     2  (  0.00%)  ( 99.99% cumulative)
[2190-2920 days]:     1  (  0.00%)  (100.00% cumulative)
[2920-3650 days]:     2  (  0.00%)  (100.00% cumulative)
[3650-4380 days]:     0  (  0.00%)  (100.00% cumulative)
[4380-5110 days]:     0  (  0.00%)  (100.00% cumulative)
[5110-5840 days]:     0  (  0.00%)  (100.00% cumulative)

The vast majority of the files—about 90 percent—are between 365 days and 504 days (1 to 1.5 years).

Then the output lists the 10 oldest files. Table 2 below lists the top 10 files based on the mtime, modify time and when the files were scanned in the original pickle file.

Table 1 - Top 10 oldest files based on mtime

RankFileMtime Age
  (days)
#1  /home/laytonjb/.libreoffice/3/user/database/biblio/biblio.dbt    3,131.167  
#2  /home/laytonjb/.libreoffice/3/user/database/biblio/biblio.dbf    3,050.282  
#3  /home/laytonjb/.libreoffice/3/user/database/biblio.odb    2,645.208  
#4  /home/laytonjb/Documents/FEATURES/HPC_021/padnums.py    2,174.615  
#5  /home/laytonjb/Documents/FEATURES/HPC_021/test_padnums.py    2,174.612  
#6  /home/laytonjb/.libreoffice/3/user/basic/Standard/Module1.xba    822.345  
#7  /home/laytonjb/.libreoffice/3/user/basic/Standard/script.xlb    822.345  
#8  /home/laytonjb/.libreoffice/3/user/basic/Standard/dialog.xlb    822.345  
#9  /home/laytonjb/.libreoffice/3/user/basic/dialog.xlc    822.345  
#10  /home/laytonjb/.libreoffice/3/user/basic/script.xlc    822.345  



These same results are repeated for ctime age (change time). The first set of results provides the overall statistical summary.

  • Average ctime age in days: 432.346 days
  • Oldest ctime age file in days: 468.926 days
  • Youngest ctime age file in days: 1.665 days
  • Standard deviation ctime age in days: 110.9462 days

The mtime file age interval counts looks like this:

[   0-   1 days]:    46  (  0.09%)  (  0.09% cumulative)
[   1-   2 days]:     0  (  0.00%)  (  0.09% cumulative)
[   2-   4 days]:    91  (  0.17%)  (  0.25% cumulative)
[   4-   7 days]:   125  (  0.23%)  (  0.48% cumulative)
[   7-  14 days]:     0  (  0.00%)  (  0.48% cumulative)
[  14-  28 days]:     1  (  0.00%)  (  0.49% cumulative)
[  28-  56 days]:  2808  (  5.20%)  (  5.68% cumulative)
[  56- 112 days]:     8  (  0.01%)  (  5.70% cumulative)
[ 112- 168 days]:   460  (  0.85%)  (  6.55% cumulative)
[ 168- 252 days]:  1736  (  3.21%)  (  9.76% cumulative)
[ 252- 365 days]:   270  (  0.50%)  ( 10.26% cumulative)
[ 365- 504 days]: 48491  ( 89.74%)  (100.00% cumulative)
[ 504- 730 days]:     0  (  0.00%)  (100.00% cumulative)
[ 730-1095 days]:     0  (  0.00%)  (100.00% cumulative)
[1095-1460 days]:     0  (  0.00%)  (100.00% cumulative)
[1460-1825 days]:     0  (  0.00%)  (100.00% cumulative)
[1825-2190 days]:     0  (  0.00%)  (100.00% cumulative)
[2190-2920 days]:     0  (  0.00%)  (100.00% cumulative)
[2920-3650 days]:     0  (  0.00%)  (100.00% cumulative)
[3650-4380 days]:     0  (  0.00%)  (100.00% cumulative)
[4380-5110 days]:     0  (  0.00%)  (100.00% cumulative)
[5110-5840 days]:     0  (  0.00%)  (100.00% cumulative)

Notice that the majority of the files are in the range of 365 to 504 days old (1 to 1.5 years).

Finally, the Top 10 oldest files based on ctime age are listed below.



Table 2 - Top 10 oldest files based on ctime

RankFileCtime Age
  (days)
#1  /home/laytonjb/.mozilla/firefox/profiles.ini    468.926  
#2  /home/laytonjb/.wine/run_configure-wine_if_no_directories_present    468.926  
#3  /home/laytonjb/.config/chromium/Default/Extensions/bjbifppfjimgbjjanagdkdgdpnlcfpcp/1.0_0/script.js    468.926  
#4  /home/laytonjb/.config/chromium/Default/Extensions/bjbifppfjimgbjjanagdkdgdpnlcfpcp/1.0_0/manifest.json    468.926  
#5  /home/laytonjb/.config/chromium/Default/databases/Databases.db    468.926  
#6  /home/laytonjb/.config/chromium/Default/User StyleSheets/Custom.css    468.926  
#7  /home/laytonjb/.config/chromium/Default/Web Data    468.926  
#8  /home/laytonjb/.config/chromium/Default/Current Session    468.926  
#9  /home/laytonjb/.config/chromium/Default/History    468.926  
#10  /home/laytonjb/.config/chromium/Default/Login Data    468.926  



Notice that some of the mtime ages are pretty old—over 3,100 days (about 8.57 years).

The next set of data will require some explanation, but I will cover that later in the article. The data is the ctime-mtime. That is the difference between the change time (ctime) and the modify time (mtime). The fundamental statistics for ctime-mtime are as follows:

  • Number of non-zero difference files: 1,339 of 54,036 files: (2.48%)
  • Average ctime-mtime age in days: 1.000 days
  • Oldest ctime-mtime age file in days: 2,665.000 days
  • Youngest ctime-mtime age file in days: 0.000 days
  • Standard deviation ctime-mtime age in days: 27.9886 days

Notice that 1,339 files out of the total of 54,036 files have the exact same ctime and mtime so that the difference is 0. Also notice that the average ctime-mtime is 1 day and the youngest file, the smallest ctime-mtime value, is 0.000 days (very small indeed).

The ctime-mtime file age interval counts look like this:

[   0-   1 days]: 52891  ( 97.88%)  ( 97.88% cumulative)
[   1-   2 days]:   641  (  1.19%)  ( 99.07% cumulative)
[   2-   4 days]:    69  (  0.13%)  ( 99.19% cumulative)
[   4-   7 days]:     5  (  0.01%)  ( 99.20% cumulative)
[   7-  14 days]:    11  (  0.02%)  ( 99.22% cumulative)
[  14-  28 days]:    61  (  0.11%)  ( 99.34% cumulative)
[  28-  56 days]:     3  (  0.01%)  ( 99.34% cumulative)
[  56- 112 days]:     2  (  0.00%)  ( 99.35% cumulative)
[ 112- 168 days]:   291  (  0.54%)  ( 99.89% cumulative)
[ 168- 252 days]:    11  (  0.02%)  ( 99.91% cumulative)
[ 252- 365 days]:    38  (  0.07%)  ( 99.98% cumulative)
[ 365- 504 days]:     8  (  0.01%)  ( 99.99% cumulative)
[ 504- 730 days]:     0  (  0.00%)  ( 99.99% cumulative)
[ 730-1095 days]:     0  (  0.00%)  ( 99.99% cumulative)
[1095-1460 days]:     0  (  0.00%)  ( 99.99% cumulative)
[1460-1825 days]:     0  (  0.00%)  ( 99.99% cumulative)
[1825-2190 days]:     3  (  0.01%)  (100.00% cumulative)
[2190-2920 days]:     2  (  0.00%)  (100.00% cumulative)
[2920-3650 days]:     0  (  0.00%)  (100.00% cumulative)
[3650-4380 days]:     0  (  0.00%)  (100.00% cumulative)
[4380-5110 days]:     0  (  0.00%)  (100.00% cumulative)
[5110-5840 days]:     0  (  0.00%)  (100.00% cumulative)

Notice that a vast majority of the files have a ctime and an mtime that differ by less than 1 day.


Page 3 of 5

Previous Page
1 2 3 4 5
Next Page

Comment and Contribute

 


(Maximum characters: 1200). You have characters left.

 

 

Storage Daily
Don't miss an article. Subscribe to our newsletter below.

Thanks for your registration, follow us on our social networks to keep up-to-date