Directory index full

General support questions
Post Reply
jscarville
Posts: 126
Joined: 2014/06/17 21:50:37

Directory index full

Post by jscarville » 2020/06/30 20:21:33

I recently tried to copy a bunch of files from an S3 container to local storage on one of our file servers. I used the aws utilty.

All the files (~11 million) are in one directory so I expected a bit of trouble but not like this. After 10,213,694 files the process stopped with an out of space error. The drive has plenty of space so I dug a bit deeper and found the following error message:

Code: Select all

EXT4-fs warning (device dm-2): ext4_dx_add_entry: Directory index full!
About 7,000 times...

This is one of our older CentOS 6 servers but is up-to-date on patches. The filesystem was formatted as ext4 with journalling.

I tried unmounting the volume and running fsck which reports the volume as clean. So I figure there is no file system corruption.

Is there some way I can expand the directory index and complete the copy?

Code: Select all

# df -hP /dev/mapper/vg_apg-apg
Filesystem              Size  Used Avail Use% Mounted on
/dev/mapper/vg_apg-apg  4.5T  3.3T  943G  79% /NFS/apg

Code: Select all

# df -hiP /dev/mapper/vg_apg-apg
Filesystem             Inodes IUsed IFree IUse% Mounted on
/dev/mapper/vg_apg-apg   288M  9.8M  279M    4% /NFS/apg

User avatar
TrevorH
Forum Moderator
Posts: 29681
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: Directory index full

Post by TrevorH » 2020/06/30 20:58:20

CentOS 6 will die in November 2020 - migrate sooner rather than later!
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 is dead, do not use it.
Full time Geek, part time moderator. Use the FAQ Luke

jscarville
Posts: 126
Joined: 2014/06/17 21:50:37

Re: Directory index full

Post by jscarville » 2020/06/30 21:52:28

Thank you.

Would it make more sense to just migrate the existing data to an XFS formatted volume and download the rest of the files to there?

Post Reply

Return to “CentOS 6 - General Support”