dcsimg

Analysis of Metadata About Metadata - Page 4

NewsletterIconSTORAGE DAILY

Want the latest storage insights?

Download the authoritative guide: Enterprise Data Storage 2018: Optimizing Your Storage Infrastructure

SHARE
Share it on Twitter  
Share it on Facebook  
Share it on Google+
Share it on Linked in  
Email  

Finally, the Top 10 oldest files based on mtime age are listed below:



Table 3 - Top 10 oldest files based on ctime-mtime

RankFileCtime-Mtime
Differences
  (days)
#1 /home/laytonjb/.libreoffice/3/user/database/biblio/biblio.dbt   2,665.394  
#2 /home/laytonjb/.libreoffice/3/user/database/biblio/biblio.dbf   2,584.508  
#3 /home/laytonjb/.libreoffice/3/user/database/biblio.odb   2,179.434  
#4 /home/laytonjb/Documents/FEATURES/HPC_021/padnums.py   2,169.680  
#5 /home/laytonjb/Documents/FEATURES/HPC_021/test_padnums.py   2,169.678  
#6 /home/laytonjb/.local/share/akonadi/mysql.conf   467.252  
#7 /home/laytonjb/CLUSTERBUFFER/OTHER2/(file)   418.744  
#8 /home/laytonjb/CLUSTERBUFFER/OTHER2/(file)   412.095  
#9 /home/laytonjb/Videos/(file)   411.090  
#10 /home/laytonjb/Videos/(file)   411.089  



Some file names have been changed so that you are not subjected to my musical tastes.

After ctime-mtime, the next set of results are for atime age. The fundamental statistics for atime age are:

  • Average atime age in days: 344.213 days
  • Oldest atime age file in days: 676.095 days
  • Youngest atime age file in days: 1.665 days
  • Standard deviation atime age in days: 151.4849 days

The atime file age interval counts look like this:


[   0-   1 days]:    66  (  0.12%)  (  0.12% cumulative)
[   1-   2 days]:     0  (  0.00%)  (  0.12% cumulative)
[   2-   4 days]:   264  (  0.49%)  (  0.61% cumulative)
[   4-   7 days]:   147  (  0.27%)  (  0.88% cumulative)
[   7-  14 days]:     0  (  0.00%)  (  0.88% cumulative)
[  14-  28 days]:     1  (  0.00%)  (  0.88% cumulative)
[  28-  56 days]:  2938  (  5.44%)  (  6.32% cumulative)
[  56- 112 days]:    57  (  0.11%)  (  6.43% cumulative)
[ 112- 168 days]:  1195  (  2.21%)  (  8.64% cumulative)
[ 168- 252 days]: 17521  ( 32.42%)  ( 41.06% cumulative)
[ 252- 365 days]:   260  (  0.48%)  ( 41.54% cumulative)
[ 365- 504 days]: 31585  ( 58.45%)  (100.00% cumulative)
[ 504- 730 days]:     2  (  0.00%)  (100.00% cumulative)
[ 730-1095 days]:     0  (  0.00%)  (100.00% cumulative)
[1095-1460 days]:     0  (  0.00%)  (100.00% cumulative)
[1460-1825 days]:     0  (  0.00%)  (100.00% cumulative)
[1825-2190 days]:     0  (  0.00%)  (100.00% cumulative)
[2190-2920 days]:     0  (  0.00%)  (100.00% cumulative)
[2920-3650 days]:     0  (  0.00%)  (100.00% cumulative)
[3650-4380 days]:     0  (  0.00%)  (100.00% cumulative)
[4380-5110 days]:     0  (  0.00%)  (100.00% cumulative)
[5110-5840 days]:     0  (  0.00%)  (100.00% cumulative)

Finally, the Top 10 oldest files based on atime age are listed below:



Table 4 - Top 10 oldest files based on atime

RankFileAtime Age
  (days)
#1 /home/laytonjb/.libreoffice/3/user/extensions/bundled/registry/com.sun.star.comp.deployment.bundle.PackageRegistryBackend/backenddb.xml   676.094  
#2 /home/laytonjb/.libreoffice/3/user/extensions/bundled/registry/com.sun.star.comp.deployment.component.PackageRegistryBackend/backenddb.xml   676.094  
#3 /home/laytonjb/.wine/run_configure-wine_if_no_directories_present   468.926  
#4 /home/laytonjb/.config/chromium/Default/Extensions/bjbifppfjimgbjjanagdkdgdpnlcfpcp/1.0_0/script.js   468.926  
#5 /home/laytonjb/.config/chromium/Default/Extensions/bjbifppfjimgbjjanagdkdgdpnlcfpcp/1.0_0/manifest.json   468.926  
#6 /home/laytonjb/.config/chromium/Default/databases/Databases.db   468.926  
#7 /home/laytonjb/.config/chromium/Default/User StyleSheets/Custom.css   468.926  
#8 /home/laytonjb/.config/chromium/Default/Web Data   468.926  
#9 /home/laytonjb/.config/chromium/Default/Current Session   468.926  
#10 /home/laytonjb/.config/chromium/Default/History   468.926  



After the data ages, the next section of results summarizes the file sizes. The overall statistics for the file sizes are:

  • Average file size in KB: 1,223.000 KB
  • Largest file in KB: 1,964,525.000 KB
  • Smallest file size in KB: 0.000 KB
  • Standard deviation file size in KB: 28,756.4219 KB

The average file size is about 1.2 MB with the smallest file being virtually zero. The largest file is 1.964 GB. The file size intervals are listed below:


[      0-      1 KB]: 17343  ( 32.10%)  ( 32.10% cumulative)
[      1-      2 KB]:  8924  ( 16.51%)  ( 48.61% cumulative)
[      2-      4 KB]:  2635  (  4.88%)  ( 53.49% cumulative)
[      4-      8 KB]:  8574  ( 15.87%)  ( 69.35% cumulative)
[      8-     16 KB]:  2261  (  4.18%)  ( 73.54% cumulative)
[     16-     32 KB]:  4688  (  8.68%)  ( 82.21% cumulative)
[     32-     64 KB]:  1929  (  3.57%)  ( 85.78% cumulative)
[     64-    128 KB]:  1758  (  3.25%)  ( 89.04% cumulative)
[    128-    256 KB]:  1186  (  2.19%)  ( 91.23% cumulative)
[    256-    512 KB]:  1000  (  1.85%)  ( 93.08% cumulative)
[    512-   1024 KB]:  1021  (  1.89%)  ( 94.97% cumulative)
[   1024-   2048 KB]:   544  (  1.01%)  ( 95.98% cumulative)
[   2048-   4096 KB]:   659  (  1.22%)  ( 97.20% cumulative)
[   4096-   8192 KB]:   585  (  1.08%)  ( 98.28% cumulative)
[   8192-  16384 KB]:   521  (  0.96%)  ( 99.24% cumulative)
[  16384-  32768 KB]:   207  (  0.38%)  ( 99.63% cumulative)
[  32768-  65536 KB]:   101  (  0.19%)  ( 99.81% cumulative)
[  65536- 131072 KB]:    47  (  0.09%)  ( 99.90% cumulative)
[ 131072- 262144 KB]:    15  (  0.03%)  ( 99.93% cumulative)
[ 262144- 524288 KB]:    10  (  0.02%)  ( 99.95% cumulative)
[ 524288-1048576 KB]:    28  (  0.05%)  (100.00% cumulative)

Notice that the majority of the files are 1KB or smaller but there are some files larger than 1 MB.

The 10 largest files are listed below in Table 5.

Table 5 - Top 10 largest files

RankFileSize (KB)
#1 /home/laytonjb/CLUSTERBUFFER/STRACENG/EXAMPLES/eclipse/strace.out8044   1,964,525  
#2 /home/laytonjb/CLUSTERBUFFER/STRACENG/EXAMPLES/eclipse/strace.out8042   1,930,658  
#3 /home/laytonjb/CLUSTERBUFFER/STRACENG/EXAMPLES/lsdyna-strace.tar.gz   1,645,833  
#4 /home/laytonjb/CLUSTERBUFFER/STRACE_PY/EXAMPLES/cesm-strace/strace.janus018.tar.bz2   1,613,158  
#5 /home/laytonjb/CLUSTERBUFFER/STRACE_PY/EXAMPLES/cesm-strace/strace.janus023.tar.bz2   1,593,503  
#6 /home/laytonjb/CLUSTERBUFFER/STRACE_PY/EXAMPLES/cesm-strace/strace.janus020.tar.bz2   1,574,873  
#7 /home/laytonjb/CLUSTERBUFFER/STRACE_PY/EXAMPLES/cesm-strace/strace.janus021.tar.bz2   1,567,006  
#8 /home/laytonjb/CLUSTERBUFFER/STRACE_PY/EXAMPLES/cesm-strace/strace.janus024.tar.bz2   1,457,958  
#9 /home/laytonjb/CLUSTERBUFFER/STRACE_PY/EXAMPLES/cesm-strace/strace.janus017.tar.bz2   1,453,175  
#10 /home/laytonjb/CLUSTERBUFFER/STRACE_PY/EXAMPLES/cesm-strace/strace.janus019.tar.bz2   1,387,286  



There are three sections after file sizes. The first one lists the Top 10 biggest users (most file space) and the second one lists the Top 10 biggest group users (most file space). The third section, which is optional by using the "-dup" option, checks for duplicate files. It compares the file name and the size of the files. If both match then it's considered a duplicate file even though it may not actually be one (need to do checksums to be sure). Since this example is only a single user, I will skip these sections.

Submit a Comment

 

People are discussing this article with 0 comment(s)