MELLOC -erros

Moderator: NorbertKrupa

Post Reply
adrian.oprea
Intermediate
Intermediate
Posts: 163
Joined: Tue Jun 19, 2012 2:44 pm
Location: Rio de Janeiro
Contact:
Contact adrian.oprea

MELLOC -erros

Post by adrian.oprea » Wed Sep 12, 2012 6:01 pm

Code: Select all

2012-09-12 13:38:11 Status: 0. Result: ['2012-09-12 13:38:07.001|Error during design||||||Design did not complete successfully.  ERROR - malloc of 546767200 bytes for StorageMergeMT buffer failed|||||']

Is it the RAM size of the machine ?
The strange part is that Vertica crushed !!! :cry:
trying so hard !!!
Top
jpcavanaugh
Intermediate
Intermediate
Posts: 149
Joined: Mon Apr 30, 2012 10:04 pm
Location: New York
Contact:
Contact jpcavanaugh

Re: MELLOC -erros

Post by jpcavanaugh » Wed Sep 12, 2012 8:07 pm

How much RAM do you have on the box?
Top
adrian.oprea
Intermediate
Intermediate
Posts: 163
Joined: Tue Jun 19, 2012 2:44 pm
Location: Rio de Janeiro
Contact:
Contact adrian.oprea

Re: MELLOC -erros

Post by adrian.oprea » Wed Sep 12, 2012 8:40 pm

Code: Select all

cat /proc/meminfo
MemTotal:        7995532 kB
MemFree:         5867888 kB
Buffers:           37828 kB
Cached:           676256 kB
SwapCached:         3680 kB
Active:          1025620 kB
Inactive:         601764 kB
Active(anon):     738592 kB
Inactive(anon):   407008 kB
Active(file):     287028 kB
Inactive(file):   194756 kB
Unevictable:          48 kB
Mlocked:              48 kB
SwapTotal:       2104316 kB
SwapFree:        2060392 kB
Dirty:               280 kB
Writeback:             0 kB
AnonPages:        910260 kB
Mapped:           135492 kB
Shmem:            232300 kB
Slab:             117884 kB
SReclaimable:      65864 kB
SUnreclaim:        52020 kB
KernelStack:        4088 kB
PageTables:            0 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:     6102080 kB
Committed_AS:    3463376 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      360876 kB
VmallocChunk:   34359347944 kB
HardwareCorrupted:     0 kB
DirectMap4k:     8017548 kB
DirectMap2M:           0 kB
trying so hard !!!
Top
adrian.oprea
Intermediate
Intermediate
Posts: 163
Joined: Tue Jun 19, 2012 2:44 pm
Location: Rio de Janeiro
Contact:
Contact adrian.oprea

Re: MELLOC -erros

Post by adrian.oprea » Wed Sep 12, 2012 8:44 pm

Is ok for the query to fail !! i don´'t care !! But why the database failed !!
Description of the ARCH:

Is Vertica CE on a single node .
(those the fact it is alone made him think he need to go ofline so he wont kill the entire "cluster"?)- a kind of fail safe ?

This a the log form a secoud try :

Code: Select all

2012-09-12 16:27:59.914 nameless:0x7f6ce800bab0 [EE] <INFO> Beginning final merge phase 3: 5 buffers to merge.
2012-09-12 16:28:00.276 nameless:0x7f6ce800bab0 <PANIC> @v_oi_node0001: 53000: Failed to allocate WOS mmap region of size 1944502272, granularity 14
        LOCATION:  init, /scratch_a/release/vbuild/vertica/SAL/WOSAlloc.cpp:86
2012-09-12 16:28:06.903 nameless:0x7f6ce800bab0 [Main] <PANIC> Wrote backtrace to ErrorReport.txt
trying so hard !!!
Top
adrian.oprea
Intermediate
Intermediate
Posts: 163
Joined: Tue Jun 19, 2012 2:44 pm
Location: Rio de Janeiro
Contact:
Contact adrian.oprea

This is the ErrorReport.txt generated by Vertica

Post by adrian.oprea » Wed Sep 12, 2012 8:56 pm

Code: Select all

BEGIN BACKTRACE
Vertica Backtrace at Wed Sep 12 16:28:00 2012
-------------------------
Vertica Analytic Database v5.1.1-0 $BrandId$
vertica(v5.1.1-0) built by release@release1-SUSE10-64 from releases/VER_5_1_RELEASE_BUILD_1_0_20120213@86663 on 'Mon Feb 13 17:46:31 2012' $BuildId$
00400000-03a3b000 r-xp 00000000 08:03 3831130                            /opt/vertica/bin/vertica
03b3b000-03c3b000 rw-p 0363b000 08:03 3831130                            /opt/vertica/bin/vertica
03c3b000-0405e000 rw-p 00000000 00:00 0                                  [heap]
7f6e44327000-7f6e44727000 rw-p 00000000 00:00 0
7f6e44727000-7f6e4473c000 r-xp 00000000 08:03 5505165                    /lib64/libgcc_s.so.1
7f6e4473c000-7f6e4493b000 ---p 00015000 08:03 5505165                    /lib64/libgcc_s.so.1
7f6e4493b000-7f6e4493c000 r--p 00014000 08:03 5505165                    /lib64/libgcc_s.so.1
7f6e4493c000-7f6e4493d000 rw-p 00015000 08:03 5505165                    /lib64/libgcc_s.so.1
7f6e4493d000-7f6e44955000 r-xp 00000000 08:03 5505114                    /lib64/libpthread-2.14.1.so
7f6e44955000-7f6e44b54000 ---p 00018000 08:03 5505114                    /lib64/libpthread-2.14.1.so
7f6e44b54000-7f6e44b55000 r--p 00017000 08:03 5505114                    /lib64/libpthread-2.14.1.so
7f6e44b55000-7f6e44b56000 rw-p 00018000 08:03 5505114                    /lib64/libpthread-2.14.1.so
7f6e44b56000-7f6e44b5a000 rw-p 00000000 00:00 0
7f6e44b5a000-7f6e44b5c000 r-xp 00000000 08:03 5505178                    /lib64/libdl-2.14.1.so
7f6e44b5c000-7f6e44d5c000 ---p 00002000 08:03 5505178                    /lib64/libdl-2.14.1.so
7f6e44d5c000-7f6e44d5d000 r--p 00002000 08:03 5505178                    /lib64/libdl-2.14.1.so
7f6e44d5d000-7f6e44d5e000 rw-p 00003000 08:03 5505178                    /lib64/libdl-2.14.1.so
7f6e44d5e000-7f6e44ee5000 r-xp 00000000 08:03 5505129                    /lib64/libc-2.14.1.so
7f6e44ee5000-7f6e450e4000 ---p 00187000 08:03 5505129                    /lib64/libc-2.14.1.so
7f6e450e4000-7f6e450e8000 r--p 00186000 08:03 5505129                    /lib64/libc-2.14.1.so
7f6e450e8000-7f6e450e9000 rw-p 0018a000 08:03 5505129                    /lib64/libc-2.14.1.so
7f6e450e9000-7f6e450ee000 rw-p 00000000 00:00 0
7f6e450ee000-7f6e450f5000 r-xp 00000000 08:03 5505350                    /lib64/librt-2.14.1.so
7f6e450f5000-7f6e452f4000 ---p 00007000 08:03 5505350                    /lib64/librt-2.14.1.so
7f6e452f4000-7f6e452f5000 r--p 00006000 08:03 5505350                    /lib64/librt-2.14.1.so
7f6e452f5000-7f6e452f6000 rw-p 00007000 08:03 5505350                    /lib64/librt-2.14.1.so
7f6e452f6000-7f6e45341000 r-xp 00000000 08:03 5505236                    /lib64/libncurses.so.5.8
7f6e45341000-7f6e45540000 ---p 0004b000 08:03 5505236                    /lib64/libncurses.so.5.8
7f6e45540000-7f6e45544000 r--p 0004a000 08:03 5505236                    /lib64/libncurses.so.5.8
7f6e45544000-7f6e4554a000 rw-p 0004e000 08:03 5505236                    /lib64/libncurses.so.5.8
7f6e4554a000-7f6e4556a000 r-xp 00000000 08:03 5505120                    /lib64/ld-2.14.1.so
7f6e455cd000-7f6e4560c000 r--p 00000000 08:03 796742                     /usr/lib/locale/pt_BR.utf8/LC_CTYPE
7f6e4560c000-7f6e4573c000 r--p 00000000 08:03 796743                     /usr/lib/locale/pt_BR.utf8/LC_COLLATE
7f6e4573c000-7f6e45741000 rw-p 00000000 00:00 0
7f6e45750000-7f6e45751000 r--p 00000000 08:03 786734                     /usr/lib/locale/pt_BR.utf8/LC_NUMERIC
7f6e45751000-7f6e45752000 r--p 00000000 08:03 934019                     /usr/lib/locale/pt_BR.utf8/LC_TIME
7f6e45752000-7f6e45753000 r--p 00000000 08:03 934017                     /usr/lib/locale/pt_BR.utf8/LC_MONETARY
7f6e45753000-7f6e45754000 r--p 00000000 08:03 786737                     /usr/lib/locale/pt_BR.utf8/LC_MESSAGES/SYS_LC_MESSAGES
7f6e45754000-7f6e45755000 r--p 00000000 08:03 786463                     /usr/lib/locale/pt_BR.utf8/LC_PAPER
7f6e45755000-7f6e45756000 r--p 00000000 08:03 786521                     /usr/lib/locale/pt_BR.utf8/LC_NAME
7f6e45756000-7f6e45757000 r--p 00000000 08:03 918301                     /usr/lib/locale/pt_BR.utf8/LC_ADDRESS
7f6e45757000-7f6e45758000 r--p 00000000 08:03 934018                     /usr/lib/locale/pt_BR.utf8/LC_TELEPHONE
7f6e45758000-7f6e45759000 r--p 00000000 08:03 786468                     /usr/lib/locale/pt_BR.utf8/LC_MEASUREMENT
7f6e45759000-7f6e45760000 r--s 00000000 08:03 1053822                    /usr/lib64/gconv/gconv-modules.cache
7f6e45760000-7f6e45761000 r--p 00000000 08:03 934016                     /usr/lib/locale/pt_BR.utf8/LC_IDENTIFICATION
7f6e45761000-7f6e4576a000 rw-p 00000000 00:00 0
7f6e4576a000-7f6e4576b000 r--p 00020000 08:03 5505120                    /lib64/ld-2.14.1.so
7f6e4576b000-7f6e4576c000 rw-p 00021000 08:03 5505120                    /lib64/ld-2.14.1.so
7f6e4576c000-7f6e4576d000 rw-p 00000000 00:00 0
7fff59ba4000-7fff59bc5000 rw-p 00000000 00:00 0                          [stack]
7fff59bff000-7fff59c00000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]

Backtrace Requested
/opt/vertica/bin/vertica(_ZN6Basics9Backtrace11DoBacktraceEiiPvS1_+0x8cc)[0x282639c]
/opt/vertica/bin/vertica(_ZN6Basics20GlobalSignalHandlers20logBacktraceFromHereEb+0xa6)[0x289c332]
/opt/vertica/bin/vertica(errthrow+0x5b)[0x2ab7691]
/opt/vertica/bin/vertica(_ZN3SAL14WosAllocRegion4initEv+0x319)[0x27e392d]
/opt/vertica/bin/vertica(_ZN3SAL8WOSAlloc11_allocBlockEPj+0xd8)[0x27e4a74]
/opt/vertica/bin/vertica(_ZN3SAL8WOSAlloc13allocateBlockEj+0x1c)[0x27e4b54]
/opt/vertica/bin/vertica(_ZN3SAL7WOSProj11getNewBlockEyjj+0x448)[0x27dc37e]
/opt/vertica/bin/vertica(_ZN2EE10DataTarget14getNewWOSBlockEjb+0x94)[0x1d7ecae]
/opt/vertica/bin/vertica(_ZN2EE10DataTarget6runWOSEv+0x3ed)[0x1d92137]
/opt/vertica/bin/vertica(_ZN2EE10DataTarget3runEv+0xa0)[0x1d94bba]
/opt/vertica/bin/vertica(_ZN2EE9NOperator7executeEv+0x10)[0x1d29598]
/opt/vertica/bin/vertica(_ZN2EE2EE11runOperatorEv+0x158)[0x1cdfeea]
/opt/vertica/bin/vertica(_ZN2EE2EE13startEEThreadEv+0x207)[0x1ce4327]
/opt/vertica/bin/vertica(_ZN2EE2EE15runOperatorShimEPv+0x70)[0x1ce49bc]
/lib64/libpthread.so.0(+0x7f05)[0x7f6e44944f05]
/lib64/libc.so.6(clone+0x6d)[0x7f6e44e3910d]
END BACKTRACE
THREAD CONTEXT
Thread type: EE Worker Thread
Request: CREATE TABLE VIEWBASE1 AS
SELECT
  DT_INI_ATIVIDADE_REDE,
  HR_INI_ATIVIDADE_REDE,
  ID1,
  LATITUDE,
  LONGITUDE,
  ORIENTACAO,
  ID2
FROM (
SELECT distinct
  B.DT_INI_ATIVIDADE_REDE,
  B.HR_INI_ATIVIDADE_REDE,
  B.CD_TELEFONE_ORIG_ALTER as "ID1",
  A.LATITUDE,
  A.LONGITUDE,
  '+1' as ORIENTACAO,
  B.CD_TELEFONE_DESTINO_ALTER as "ID2"
FROM ANTENA0 A, BILHETE1 B, SUBSCRICAO1 C
WHERE A.CELL_ID = (B.NU_SETOR_CELULA_ORIG/100000000)
  AND C.NUM_TEL_ALTER = B.CD_TELEFONE_ORIG_ALTER
  AND C.NUM_TEL_ALTER != B.CD_TELEFONE_DESTINO_ALTER
UNION all
SELECT distinct
  B.DT_INI_ATIVIDADE_REDE,
  B.HR_INI_ATIVIDADE_REDE,
  B.CD_TELEFONE_DESTINO_ALTER as "ID1",
  A.LATITUDE,
  A.LONGITUDE,
  '-1' as ORIENTACAO,
  B.CD_TELEFONE_ORIG_ALTER as "ID2"
FROM ANTENA0 A, BILHETE1 B, SUBSCRICAO1 C
WHERE A.CELL_ID = (B.NU_SETOR_CELULA_ORIG/100000000)
  AND C.NUM_TEL_ALTER = B.CD_TELEFONE_DESTINO_ALTER
  AND C.NUM_TEL_ALTER != B.CD_TELEFONE_ORIG_ALTER
UNION all
SELECT distinct
  B.DT_INI_ATIVIDADE_REDE,
  B.HR_INI_ATIVIDADE_REDE,
  B.CD_TELEFONE_DESTINO_ALTER as "ID1",
  A.LATITUDE,
  A.LONGITUDE,
  '+1' as ORIENTACAO,
  B.CD_TELEFONE_ORIG_ALTER as "ID2"
FROM ANTENA0 A, BILHETE1 B, SUBSCRICAO1 C
WHERE A.CELL_ID = (B.NU_SETOR_CELULA_ORIG/100000000)
  AND C.NUM_TEL_ALTER = B.CD_TELEFONE_DESTINO_ALTER
  AND C.NUM_TEL_ALTER = B.CD_TELEFONE_ORIG_ALTER
  ) AS SUB1
ORDER BY DT_INI_ATIVIDADE_REDE, HR_INI_ATIVIDADE_REDE;
           1: Root
           0: GroupByNothing
FAULT =>  57: DataTarget
           2: NewEENode
              ExprEval
              Sort
              UnionAll
              ExprEval
              GroupByHash
              ExprEval
              Join
              Join
              StorageUnion
              Scan
              Scan
              Scan
              Scan
              StorageUnion
              Scan
              Scan
              Scan
              Scan
              StorageUnion
              Scan
              ExprEval
              GroupByHash
              ExprEval
              Join
              Join
              StorageUnion
              Scan
              Scan
              Scan
              Scan
              StorageUnion
              Scan
              Scan
              Scan
              Scan
              StorageUnion
              Scan
              ExprEval
              GroupByHash
              ExprEval
              Join
              Join
              StorageUnion
              Scan
              Scan
              Scan
              Scan
              StorageUnion
              Scan
              Scan
              Scan
              Scan
              StorageUnion
              Scan
END THREAD CONTEXT
trying so hard !!!
Top
adrian.oprea
Intermediate
Intermediate
Posts: 163
Joined: Tue Jun 19, 2012 2:44 pm
Location: Rio de Janeiro
Contact:
Contact adrian.oprea

Re: MELLOC -erros

Post by adrian.oprea » Wed Sep 12, 2012 9:01 pm

While running the select thru the database designer it tells me that :

Code: Select all

2012-09-12 13:38:12 Status: 0. Result: ['Design did not complete successfully.  ERROR - malloc of 546767200 bytes for StorageMergeMT buffer failed']
2012-09-12 13:38:13 The error is: Design did not complete successfully.  ERROR - malloc of 546767200 bytes for StorageMergeMT buffer failed
-- so i know i hove to give more resources blabla bla , but why does it kill my DB while running directly at vsql line ?
trying so hard !!!
Top
jpcavanaugh
Intermediate
Intermediate
Posts: 149
Joined: Mon Apr 30, 2012 10:04 pm
Location: New York
Contact:
Contact jpcavanaugh

Re: MELLOC -erros

Post by jpcavanaugh » Wed Sep 12, 2012 10:14 pm

This looks "off" - I would open up a support request with Vertica.
Top
Post Reply

Return to “Vertica Database Administration”