ERROR 2344: Cannot allocate sufficient memory for COPY ...

[hemhum]

Hello, When I use copy statment I get an error.
ERROR 2344: Cannot allocate sufficient memory for COPY statement (536870912 requested, 268435456 permitted)
the copy statment is :
COPY F_OUTPS_COST(patid,patnumb,F010500_Z5,F080500_L,f010301,F100103_K,f090400,f100102,F020500_E,f100101,f000000,f000001,F060100_A,F070100_B,F070200_C,F100100_F,f010102,F030202_N,F030300_Z,F080100_L1,F030201_N1,F050203_Z1,F090500_Z2,F090300_Z4,F050204_Z6,F100104_V,F100105_Y,F100106_G,tjks,jzh,ylzh,brxm,blh,ksbm,sfbl,sfmonth,ysbm,ysxm,zfje,zje,sfrq format 'YYYY/MM/DD hh24:mi:ss',sflx,F090600,F090700,F090800,F090900,F030203,F030204,F100107_Z8,F090501_Z3,ZYF,ZZLF,ZHYF,ZSSF,F100108_Z0,F100109_Z9,F020501_EK,F020502_EL,F020503_E3,F020504_EM,F020505_EO,F020506_EN,F020507_E0,F020508_E1,F020509_E2,F020510_E4,F020511_E5,F020512_E6,F020513_E7,F020514_E8,F020515_EA,F020516_EB,F020517_EC,F020518_ED,F020519_EE,F020520_EF,F020521_EG,F020522_EH,F020523_EI,F020524_EJ,F100200_F1,F100300_F2,F100206_G2,ZJCF,ZQTFY,ZZCF,ZCLF,ZYBZLF,ZWSCLF,ZQTMZFY) FROM LOCAL '/homeadmin/F_OUTPS_COST.txt' DELIMITER '@' RECORD TERMINATOR '#@#' enclosed by '"' DIRECT REJECTED DATA '/homeadmin/REJ_F_OUTPS_COST.txt' EXCEPTIONS '/homeadmin/EX_F_OUTPS_COST.txt';

i succesfully execute this copy statment on one server ,but i get an error when i exec the same statment on another server
how to resolve this problem, and what reason is ?? Any suggestion appreciated. Thanks.

[nnani]

Hello hemhem,

First of all when you say

i succesfully execute this copy statment on one server ,but i get an error when i exec the same statment on another server

What do you mean by this.

Are you saying when you fired your query from one node it worked fine and from other node it didn't

try increasing the memory cap for this user.

[hemhum]

I have two single vertica instance，one is production env，another is develop env
the copy command can succesfully exec on prodution env，but failed on develop env

[id10t]

HI!

1. Are they same - prod and dev?
2. Do you get warning or something like this? :

Code: Select all

daniel=> select distinct error_level, message from error_messages where message ilike 'Vertica suggests%';
-[ RECORD 1 ]------------------------------------------------
error_level | WARNING
message     | Vertica suggests 2GB of memory or more per core

3. Is join spill enabled ?Explicitly? Implicitly?

[pborne]

Check the resource pool you are using to load the data.