Not using > 1TB Ram

Issues related to hardware problems
Post Reply
splat-man
Posts: 3
Joined: 2022/06/09 19:32:38

Not using > 1TB Ram

Post by splat-man » 2022/06/09 19:36:38

I have a System Centos 7 has been running with 768GB of Ram for a couple of years now . added 512 GB ram to bring itthe 1.25 TB of ram.
Installed it no problem , the Mother sees it , lshw sees it , However the OS is only reporting using 1TB of ram

I'm sure it is something simple I'm missing. But I can't figure it out

Code: Select all

[root@xtc kernel]# lshw
xtc
    description: Desktop Computer
    product: RS700-E9-RS4 (SKU)
    vendor: ASUSTeK COMPUTER INC.
    version: Rev 1.xx
    serial: H7S0CG0001FX
    width: 64 bits
    capabilities: smbios-3.0.0 dmi-3.0.0 smp vsyscall32
    configuration: boot=normal chassis=desktop family=Server sku=SKU uuid=AB1233                                                                         EC-69AC-7411-A698-88D7F6AECDE8
  *-core
       description: Motherboard
       product: Z11PP-D24 Series
       vendor: ASUSTeK COMPUTER INC.
       physical id: 0
       version: Rev 1.xx
       serial: 176803057400060
       slot: To Be Filled By O.E.M.
     *-firmware
          description: BIOS
          vendor: American Megatrends Inc.
          physical id: 0
          version: 0403
          date: 07/04/2017
          size: 64KiB
          capacity: 16MiB
          capabilities: pci apm upgrade shadowing cdboot bootselect socketedrom                                                                          edd int13floppy1200 int13floppy720 int13floppy2880 int5printscreen int9keyboard                                                                          int14serial int17printer acpi usb biosbootspecification uefi
     *-memory
          description: System Memory
          physical id: 31
          slot: System board or motherboard
          size: 1280GiB                         <------------- Memory seen here! 
          capabilities: ecc
          configuration: errordetection=ecc
        *-bank:0


[root@xtc kernel]# free -h
              total        used        free      shared  buff/cache   available
Mem:           1.0T         11G        993G         19M        351M        992G
Swap:          935G          0B        935G
[root@xtc kernel]# uname -a
Linux xtc 3.10.0-1160.66.1.el7.x86_64 #1 SMP Wed May 18 16:02:34 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
[root@xtc kernel]# cat /etc/redhat-release
CentOS Linux release 7.9.2009 (Core)
[root@xtc kernel]#
[root@xtc kernel]# cat /proc/meminfo
MemTotal:       1054167808 kB
MemFree:        608321080 kB
MemAvailable:   1035182472 kB
Buffers:            1400 kB
Cached:         427501204 kB
SwapCached:            0 kB
Active:         23638748 kB
Inactive:       409055088 kB
Active(anon):    5196164 kB
Inactive(anon):    19300 kB
Active(file):   18442584 kB
Inactive(file): 409035788 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      980955128 kB
SwapFree:       980955128 kB
Dirty:             16520 kB
Writeback:        316780 kB
AnonPages:       5191820 kB
Mapped:           675296 kB
Shmem:             23720 kB
Slab:            1681048 kB
SReclaimable:    1325592 kB
SUnreclaim:       355456 kB
KernelStack:       29504 kB
PageTables:        77344 kB
NFS_Unstable:     284904 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    1508039032 kB
Committed_AS:   12482536 kB
VmallocTotal:   34359738367 kB
VmallocUsed:     2269720 kB
VmallocChunk:   33951551484 kB
Percpu:           100928 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1560576 kB
CmaTotal:              0 kB
CmaFree:               0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      320044 kB
DirectMap2M:     8738816 kB
DirectMap1G:    1064304640 kB

User avatar
TrevorH
Site Admin
Posts: 33216
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: Not using > 1TB Ram

Post by TrevorH » 2022/06/09 20:45:29

Post the output from dmesg -T | grep -iE "mem|ram"
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke

splat-man
Posts: 3
Joined: 2022/06/09 19:32:38

Re: Not using > 1TB Ram

Post by splat-man » 2022/06/10 13:29:50

Here you go


[root@xtc kernel]# dmesg -T | grep -iE "mem|ram"
[Tue Jun 7 15:48:20 2022] e820: BIOS-provided physical RAM map:
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x0000000000000000-0x000000000009d3ff] usable
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x000000000009d400-0x000000000009ffff] reserved
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x0000000000100000-0x0000000068885fff] usable
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x0000000068886000-0x000000006c76efff] reserved
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x000000006c76f000-0x000000006c86efff] usable
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x000000006c86f000-0x000000006d40dfff] ACPI NVS
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x000000006d40e000-0x000000006f2fafff] reserved
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x000000006f2fb000-0x000000006f7fffff] usable
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x000000006f800000-0x000000008fffffff] reserved
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x00000000fd000000-0x00000000fe7fffff] reserved
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x00000000fed20000-0x00000000fed44fff] reserved
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x0000000100000000-0x000000ffffffffff] usable
[Tue Jun 7 15:48:20 2022] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[Tue Jun 7 15:48:20 2022] e820: remove [mem 0x000a0000-0x000fffff] usable
[Tue Jun 7 15:48:20 2022] total RAM covered: 1046512M
[Tue Jun 7 15:48:20 2022] gran_size: 64K chunk_size: 1024G num_reg: 3 lose cover RAM: 0G
[Tue Jun 7 15:48:20 2022] e820: update [mem 0x7f000000-0xffffffff] usable ==> reserved
[Tue Jun 7 15:48:20 2022] Base memory trampoline at [ffff912f00097000] 97000 size 24576
[Tue Jun 7 15:48:20 2022] RAMDISK: [mem 0x34353000-0x361a1fff]
[Tue Jun 7 15:48:20 2022] SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[Tue Jun 7 15:48:20 2022] SRAT: Node 0 PXM 0 [mem 0x100000000-0x603fffffff]
[Tue Jun 7 15:48:20 2022] SRAT: Node 0 PXM 0 [mem 0x6040000000-0xa03fffffff]
[Tue Jun 7 15:48:20 2022] SRAT: Node 1 PXM 1 [mem 0xa040000000-0xff7fffffff]
[Tue Jun 7 15:48:20 2022] SRAT: Node 1 PXM 1 [mem 0xff80000000-0xffffffffff]
[Tue Jun 7 15:48:20 2022] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x603fffffff] -> [mem 0x00000000-0x603fffffff]
[Tue Jun 7 15:48:20 2022] NUMA: Node 0 [mem 0x00000000-0x603fffffff] + [mem 0x6040000000-0xa03fffffff] -> [mem 0x00000000-0xa03fffffff]
[Tue Jun 7 15:48:20 2022] NUMA: Node 1 [mem 0xa040000000-0xff7fffffff] + [mem 0xff80000000-0xffffffffff] -> [mem 0xa040000000-0xffffffffff]
[Tue Jun 7 15:48:20 2022] NODE_DATA(0) allocated [mem 0xa03ffd9000-0xa03fffffff]
[Tue Jun 7 15:48:20 2022] NODE_DATA(1) allocated [mem 0xfffffd7000-0xffffffdfff]
[Tue Jun 7 15:48:20 2022] Reserving 224MB of memory at 608MB for crashkernel (System RAM: 1046158MB)
[Tue Jun 7 15:48:20 2022] DMA [mem 0x00001000-0x00ffffff]
[Tue Jun 7 15:48:20 2022] DMA32 [mem 0x01000000-0xffffffff]
[Tue Jun 7 15:48:20 2022] Normal [mem 0x100000000-0xffffffffff]
[Tue Jun 7 15:48:20 2022] Early memory node ranges
[Tue Jun 7 15:48:20 2022] node 0: [mem 0x00001000-0x0009cfff]
[Tue Jun 7 15:48:20 2022] node 0: [mem 0x00100000-0x68885fff]
[Tue Jun 7 15:48:20 2022] node 0: [mem 0x6c76f000-0x6c86efff]
[Tue Jun 7 15:48:20 2022] node 0: [mem 0x6f2fb000-0x6f7fffff]
[Tue Jun 7 15:48:20 2022] node 0: [mem 0x100000000-0xa03fffffff]
[Tue Jun 7 15:48:20 2022] node 1: [mem 0xa040000000-0xffffffffff]
[Tue Jun 7 15:48:20 2022] Initmem setup node 0 [mem 0x00001000-0xa03fffffff]
[Tue Jun 7 15:48:20 2022] DMA zone: 64 pages used for memmap
[Tue Jun 7 15:48:20 2022] DMA32 zone: 6651 pages used for memmap
[Tue Jun 7 15:48:20 2022] Normal zone: 2609152 pages used for memmap
[Tue Jun 7 15:48:20 2022] Initmem setup node 1 [mem 0xa040000000-0xffffffffff]
[Tue Jun 7 15:48:20 2022] Normal zone: 1568768 pages used for memmap
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0x0009d000-0x0009dfff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0x68886000-0x6c76efff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0x6c86f000-0x6d40dfff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0x6d40e000-0x6f2fafff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0x6f800000-0x8fffffff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0x90000000-0xfcffffff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0xfd000000-0xfe7fffff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0xfe800000-0xfed1ffff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0xfed20000-0xfed44fff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff]
[Tue Jun 7 15:48:20 2022] PM: Registered nosave memory: [mem 0xff000000-0xffffffff]
[Tue Jun 7 15:48:20 2022] e820: [mem 0x90000000-0xfcffffff] available for PCI devices
[Tue Jun 7 15:48:20 2022] Memory: 9780972k/1073741824k available (7812k kernel code, 2475876k absent, 17132080k reserved, 5932k data, 1980k init)
[Tue Jun 7 15:48:20 2022] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[Tue Jun 7 15:48:20 2022] Security Framework initialized
[Tue Jun 7 15:48:20 2022] Initializing cgroup subsys memory
[Tue Jun 7 15:48:25 2022] x86/mm: Memory block size: 2048MB
[Tue Jun 7 15:48:25 2022] PM: Registering ACPI NVS region [mem 0x6c86f000-0x6d40dfff] (12185600 bytes)
[Tue Jun 7 15:48:25 2022] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[Tue Jun 7 15:48:25 2022] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[Tue Jun 7 15:48:25 2022] pmd_set_huge: Cannot satisfy [mem 0x80000000-0x80200000] with a huge-page mapping due to MTRR override.
[Tue Jun 7 15:48:26 2022] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:00: root bus resource [mem 0xfe010000-0xfe010fff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:00: root bus resource [mem 0x90000000-0x9d7fffff window]
[Tue Jun 7 15:48:26 2022] pci 0000:00:04.0: reg 0x10: [mem 0x9c230000-0x9c233fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:04.1: reg 0x10: [mem 0x9c22c000-0x9c22ffff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:04.2: reg 0x10: [mem 0x9c228000-0x9c22bfff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:04.3: reg 0x10: [mem 0x9c224000-0x9c227fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:04.4: reg 0x10: [mem 0x9c220000-0x9c223fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:04.5: reg 0x10: [mem 0x9c21c000-0x9c21ffff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:04.6: reg 0x10: [mem 0x9c218000-0x9c21bfff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:04.7: reg 0x10: [mem 0x9c214000-0x9c217fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:05.4: reg 0x10: [mem 0x9c23e000-0x9c23efff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:11.0: device has non-compliant BARs; disabling IO/MEM decoding
[Tue Jun 7 15:48:26 2022] pci 0000:00:11.5: reg 0x10: [mem 0x9c236000-0x9c237fff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:11.5: reg 0x14: [mem 0x9c23d000-0x9c23d0ff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:11.5: reg 0x24: [mem 0x9c180000-0x9c1fffff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:14.0: reg 0x10: [mem 0x9c200000-0x9c20ffff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:14.2: reg 0x10: [mem 0x9c23c000-0x9c23cfff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:16.0: reg 0x10: [mem 0x9c23b000-0x9c23bfff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:16.1: reg 0x10: [mem 0x9c23a000-0x9c23afff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:16.4: reg 0x10: [mem 0x9c239000-0x9c239fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:17.0: reg 0x10: [mem 0x9c234000-0x9c235fff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:17.0: reg 0x14: [mem 0x9c238000-0x9c2380ff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:17.0: reg 0x24: [mem 0x9c100000-0x9c17ffff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:1f.2: reg 0x10: [mem 0x9c210000-0x9c213fff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:1f.4: reg 0x10: [mem 0x00000000-0x000000ff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:1f.5: reg 0x10: [mem 0xfe010000-0xfe010fff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.4: bridge window [mem 0x98000000-0x9c0fffff]
[Tue Jun 7 15:48:26 2022] pci 0000:03:00.0: reg 0x10: [mem 0x98000000-0x9bffffff]
[Tue Jun 7 15:48:26 2022] pci 0000:03:00.0: reg 0x14: [mem 0x9c000000-0x9c01ffff]
[Tue Jun 7 15:48:26 2022] pci 0000:02:00.0: bridge window [mem 0x98000000-0x9c0fffff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:17: root bus resource [mem 0x9d800000-0xaaffffff window]
[Tue Jun 7 15:48:26 2022] pci 0000:17:05.4: reg 0x10: [mem 0xaaf00000-0xaaf00fff]
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.0: reg 0x10: [mem 0xaae20000-0xaae3ffff]
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.0: reg 0x1c: [mem 0xaaec4000-0xaaec7fff]
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.0: reg 0x184: [mem 0xaaea0000-0xaaea3fff]
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.0: VF(n) BAR0 space: [mem 0xaaea0000-0xaaebffff] (contains BAR0 for 8 VFs)
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.0: reg 0x190: [mem 0xaae80000-0xaae83fff]
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.0: VF(n) BAR3 space: [mem 0xaae80000-0xaae9ffff] (contains BAR3 for 8 VFs)
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.1: reg 0x10: [mem 0xaae00000-0xaae1ffff]
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.1: reg 0x1c: [mem 0xaaec0000-0xaaec3fff]
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.1: reg 0x184: [mem 0xaae60000-0xaae63fff]
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.1: VF(n) BAR0 space: [mem 0xaae60000-0xaae7ffff] (contains BAR0 for 8 VFs)
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.1: reg 0x190: [mem 0xaae40000-0xaae43fff]
[Tue Jun 7 15:48:26 2022] pci 0000:18:00.1: VF(n) BAR3 space: [mem 0xaae40000-0xaae5ffff] (contains BAR3 for 8 VFs)
[Tue Jun 7 15:48:26 2022] pci 0000:17:01.0: bridge window [mem 0xaae00000-0xaaefffff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:3a: root bus resource [mem 0xab000000-0xb87fffff window]
[Tue Jun 7 15:48:26 2022] pci 0000:3a:05.4: reg 0x10: [mem 0xb8700000-0xb8700fff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:5d: root bus resource [mem 0xb8800000-0xc5ffffff window]
[Tue Jun 7 15:48:26 2022] pci 0000:5d:05.4: reg 0x10: [mem 0xc5f00000-0xc5f00fff]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.0: reg 0x10: [mem 0xc5600000-0xc57fffff 64bit pref]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.0: reg 0x20: [mem 0xc5804000-0xc5807fff 64bit pref]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.0: reg 0x30: [mem 0xc5a80000-0xc5afffff pref]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.0: reg 0x184: [mem 0xc5e00000-0xc5e03fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.0: VF(n) BAR0 space: [mem 0xc5e00000-0xc5efffff 64bit] (contains BAR0 for 64 VFs)
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.0: reg 0x190: [mem 0xc5d00000-0xc5d03fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.0: VF(n) BAR3 space: [mem 0xc5d00000-0xc5dfffff 64bit] (contains BAR3 for 64 VFs)
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.1: reg 0x10: [mem 0xc5400000-0xc55fffff 64bit pref]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.1: reg 0x20: [mem 0xc5800000-0xc5803fff 64bit pref]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.1: reg 0x30: [mem 0xc5a00000-0xc5a7ffff pref]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.1: reg 0x184: [mem 0xc5c00000-0xc5c03fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.1: VF(n) BAR0 space: [mem 0xc5c00000-0xc5cfffff 64bit] (contains BAR0 for 64 VFs)
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.1: reg 0x190: [mem 0xc5b00000-0xc5b03fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:5e:00.1: VF(n) BAR3 space: [mem 0xc5b00000-0xc5bfffff 64bit] (contains BAR3 for 64 VFs)
[Tue Jun 7 15:48:26 2022] pci 0000:5d:00.0: bridge window [mem 0xc5a00000-0xc5efffff]
[Tue Jun 7 15:48:26 2022] pci 0000:5d:00.0: bridge window [mem 0xc5400000-0xc58fffff 64bit pref]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:80: root bus resource [mem 0xc6000000-0xd37fffff window]
[Tue Jun 7 15:48:26 2022] pci 0000:80:04.0: reg 0x10: [mem 0xd371c000-0xd371ffff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:80:04.1: reg 0x10: [mem 0xd3718000-0xd371bfff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:80:04.2: reg 0x10: [mem 0xd3714000-0xd3717fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:80:04.3: reg 0x10: [mem 0xd3710000-0xd3713fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:80:04.4: reg 0x10: [mem 0xd370c000-0xd370ffff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:80:04.5: reg 0x10: [mem 0xd3708000-0xd370bfff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:80:04.6: reg 0x10: [mem 0xd3704000-0xd3707fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:80:04.7: reg 0x10: [mem 0xd3700000-0xd3703fff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:80:05.4: reg 0x10: [mem 0xd3720000-0xd3720fff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:85: root bus resource [mem 0xd3800000-0xe0ffffff window]
[Tue Jun 7 15:48:26 2022] pci 0000:85:05.4: reg 0x10: [mem 0xe0f00000-0xe0f00fff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:ae: root bus resource [mem 0xe1000000-0xee7fffff window]
[Tue Jun 7 15:48:26 2022] pci 0000:ae:05.4: reg 0x10: [mem 0xee700000-0xee700fff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:d7: root bus resource [mem 0xee800000-0xfbffffff window]
[Tue Jun 7 15:48:26 2022] pci 0000:d7:05.4: reg 0x10: [mem 0xfbf00000-0xfbf00fff]
[Tue Jun 7 15:48:26 2022] vgaarb: device added: PCI:0000:03:00.0,decodes=io+mem,owns=io+mem,locks=none
[Tue Jun 7 15:48:26 2022] e820: reserve RAM buffer [mem 0x0009d400-0x0009ffff]
[Tue Jun 7 15:48:26 2022] e820: reserve RAM buffer [mem 0x68886000-0x6bffffff]
[Tue Jun 7 15:48:26 2022] e820: reserve RAM buffer [mem 0x6c86f000-0x6fffffff]
[Tue Jun 7 15:48:26 2022] e820: reserve RAM buffer [mem 0x6f800000-0x6fffffff]
[Tue Jun 7 15:48:26 2022] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved
[Tue Jun 7 15:48:26 2022] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:01: [mem 0xff000000-0xffffffff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:05: [mem 0xfd000000-0xfdabffff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:05: [mem 0xfdad0000-0xfdadffff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:05: [mem 0xfdb00000-0xfdffffff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:05: [mem 0xfe000000-0xfe00ffff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:05: [mem 0xfe011000-0xfe01ffff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:05: [mem 0xfe036000-0xfe03bfff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:05: [mem 0xfe03d000-0xfe3fffff] has been reserved
[Tue Jun 7 15:48:26 2022] system 00:05: [mem 0xfe410000-0xfe7fffff] has been reserved
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 200000 add_align 100000
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.0: res[14]=[mem 0x00100000-0x000fffff] res_to_dev_res add_size 200000 min_align 100000
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.0: res[14]=[mem 0x00100000-0x002fffff] res_to_dev_res add_size 200000 min_align 100000
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.0: res[15]=[mem 0x00100000-0x000fffff 64bit pref] res_to_dev_res add_size 200000 min_align 100000
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.0: res[15]=[mem 0x00100000-0x002fffff 64bit pref] res_to_dev_res add_size 200000 min_align 100000
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.0: BAR 14: assigned [mem 0x90000000-0x901fffff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.0: BAR 15: assigned [mem 0x90200000-0x903fffff 64bit pref]
[Tue Jun 7 15:48:26 2022] pci 0000:00:1f.4: BAR 0: assigned [mem 0x90400000-0x904000ff 64bit]
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.0: bridge window [mem 0x90000000-0x901fffff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.0: bridge window [mem 0x90200000-0x903fffff 64bit pref]
[Tue Jun 7 15:48:26 2022] pci 0000:02:00.0: bridge window [mem 0x98000000-0x9c0fffff]
[Tue Jun 7 15:48:26 2022] pci 0000:00:1c.4: bridge window [mem 0x98000000-0x9c0fffff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:00: resource 9 [mem 0x000a0000-0x000bffff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:00: resource 10 [mem 0x000c4000-0x000c7fff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:00: resource 11 [mem 0xfe010000-0xfe010fff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:00: resource 12 [mem 0x90000000-0x9d7fffff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:01: resource 1 [mem 0x90000000-0x901fffff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:01: resource 2 [mem 0x90200000-0x903fffff 64bit pref]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:02: resource 1 [mem 0x98000000-0x9c0fffff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:03: resource 1 [mem 0x98000000-0x9c0fffff]
[Tue Jun 7 15:48:26 2022] pci 0000:17:01.0: bridge window [mem 0xaae00000-0xaaefffff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:17: resource 5 [mem 0x9d800000-0xaaffffff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:18: resource 1 [mem 0xaae00000-0xaaefffff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:3a: resource 5 [mem 0xab000000-0xb87fffff window]
[Tue Jun 7 15:48:26 2022] pci 0000:5d:00.0: bridge window [mem 0xc5a00000-0xc5efffff]
[Tue Jun 7 15:48:26 2022] pci 0000:5d:00.0: bridge window [mem 0xc5400000-0xc58fffff 64bit pref]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:5d: resource 5 [mem 0xb8800000-0xc5ffffff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:5e: resource 1 [mem 0xc5a00000-0xc5efffff]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:5e: resource 2 [mem 0xc5400000-0xc58fffff 64bit pref]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:80: resource 5 [mem 0xc6000000-0xd37fffff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:85: resource 5 [mem 0xd3800000-0xe0ffffff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:ae: resource 5 [mem 0xe1000000-0xee7fffff window]
[Tue Jun 7 15:48:26 2022] pci_bus 0000:d7: resource 5 [mem 0xee800000-0xfbffffff window]
[Tue Jun 7 15:48:26 2022] Unpacking initramfs...
[Tue Jun 7 15:48:26 2022] Freeing initrd memory: 31036k freed
[Tue Jun 7 15:48:26 2022] software IO TLB [mem 0x64886000-0x68886000] (64MB) mapped at [ffff912f64886000-ffff912f68885fff]
[Tue Jun 7 15:48:26 2022] RAPL PMU: hw unit of domain dram 2^-16 Joules
[Tue Jun 7 15:48:26 2022] Non-volatile memory driver v1.3
[Tue Jun 7 15:48:26 2022] crash memory driver: version 1.1
[Tue Jun 7 15:48:26 2022] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810
[Tue Jun 7 15:48:26 2022] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[Tue Jun 7 15:48:26 2022] BERT: Boot Error Record Table support is disabled. Enable it by using bert_enable as kernel parameter.
[Tue Jun 7 15:48:26 2022] Freeing unused kernel memory: 1980k freed
[Tue Jun 7 15:48:26 2022] Freeing unused kernel memory: 368k freed
[Tue Jun 7 15:48:26 2022] Freeing unused kernel memory: 528k freed
[Tue Jun 7 15:48:26 2022] systemd[1]: Running in initial RAM disk.
[Tue Jun 7 15:48:27 2022] [drm] dram MCLK=800 Mhz type=8 bus_width=16 size=04000000
[Tue Jun 7 15:48:27 2022] [TTM] Zone kernel: Available graphics memory: 527083904 kiB
[Tue Jun 7 15:48:27 2022] [TTM] Zone dma32: Available graphics memory: 2097152 kiB
[Tue Jun 7 15:48:27 2022] Console: switching to colour frame buffer device 200x75
[Tue Jun 7 15:48:27 2022] ast 0000:03:00.0: fb0: astdrmfb frame buffer device
[Tue Jun 7 15:48:33 2022] intel_rapl: Found RAPL domain dram
[Tue Jun 7 15:48:33 2022] intel_rapl: DRAM domain energy unit 15300pj
[Tue Jun 7 15:48:33 2022] intel_rapl: Found RAPL domain dram
[Tue Jun 7 15:48:33 2022] intel_rapl: DRAM domain energy unit 15300pj
You have new mail in /var/spool/mail/root

User avatar
TrevorH
Site Admin
Posts: 33216
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: Not using > 1TB Ram

Post by TrevorH » 2022/06/13 12:05:18

[Tue Jun 7 15:48:20 2022] BIOS-e820: [mem 0x0000000100000000-0x000000ffffffffff] usable
This appears to be the highest number reported by the BIOS e820 call and I make that 1TB give or take a byte or few. I'd look at BIOS updates and/or reporting the problem to the motherboard manufacturer. You could also try appending mem= to the kernel command line and see if that works though I would do that from the grub menu at boot time as a one-shot to make sure it works before you edit grub.cfg and make it permanent just in case it does not work at all.
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke

splat-man
Posts: 3
Joined: 2022/06/09 19:32:38

Re: Not using > 1TB Ram

Post by splat-man » 2022/06/13 13:21:55

OK, I'll see what I can do .

what wouldthe Syntax of the appending memory be ? I want to make sure I do it right


also The Bios see the 1.25 TB of mem

when I do an lshw it shows the memory

[root@xtc kernel]# lshw
xtc
description: Desktop Computer
product: RS700-E9-RS4 (SKU)
vendor: ASUSTeK COMPUTER INC.
version: Rev 1.xx
serial: H7S0CG0001FX
width: 64 bits
capabilities: smbios-3.0.0 dmi-3.0.0 smp vsyscall32
configuration: boot=normal chassis=desktop family=Server sku=SKU uuid=AB1233 EC-69AC-7411-A698-88D7F6AECDE8
*-core
description: Motherboard
product: Z11PP-D24 Series
vendor: ASUSTeK COMPUTER INC.
physical id: 0
version: Rev 1.xx
serial: 176803057400060
slot: To Be Filled By O.E.M.
*-firmware
description: BIOS
vendor: American Megatrends Inc.
physical id: 0
version: 0403
date: 07/04/2017
size: 64KiB
capacity: 16MiB
capabilities: pci apm upgrade shadowing cdboot bootselect socketedrom edd int13floppy1200 int13floppy720 int13floppy2880 int5printscreen int9keyboard int14serial int17printer acpi usb biosbootspecification uefi
*-memory
description: System Memory
physical id: 31
slot: System board or motherboard
size: 1280GiB <------------- Memory seen here!
capabilities: ecc
configuration: errordetection=ecc
*-bank:0

chemal
Posts: 776
Joined: 2013/12/08 19:44:49

Re: Not using > 1TB Ram

Post by chemal » 2022/06/13 17:43:01

Linux relies on e820, other tools may resort to other means.

Did you follow the memory population rules from the manual? My guess is that you now have 20 DIMMs @64GB each. There is only one correct way to install them.

User avatar
TrevorH
Site Admin
Posts: 33216
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: Not using > 1TB Ram

Post by TrevorH » 2022/06/13 19:21:05

what wouldthe Syntax of the appending memory be ? I want to make sure I do it right
See /usr/share/doc/kernel-doc-3.10.0/Documentation/kernel-parameters.txt (part of kernel-doc) and search for mem=
mem=nn[KMG] [KNL,BOOT] Force usage of a specific amount of memory
Amount of memory to be used when the kernel is not able
to see the whole system memory or for test.
[X86] Work as limiting max address. Use together
with memmap= to avoid physical address space collisions.
Without memmap= PCI devices could be placed at addresses
belonging to unused RAM.
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke

Post Reply