Load 100000 files

Moderator: NorbertKrupa

Post Reply
User avatar
nnani
Master
Master
Posts: 302
Joined: Fri Apr 13, 2012 6:28 am
Contact:

Load 100000 files

Post by nnani » Sun Apr 22, 2012 9:46 am

I have to load 100000 files into one table of Vertica database these files are splitted on three nodes node1 , node2 , node3. What is the best way to do it?
I am trying to make a script with the help of echo and for loop. Please help me with this.
nnani........
Long way to go

You can check out my blogs at vertica-howto

rajasekhart
Intermediate
Intermediate
Posts: 87
Joined: Wed Apr 25, 2012 8:10 am

Re: Load 100000 files

Post by rajasekhart » Wed May 09, 2012 1:11 pm

Hi Navin,

I am new to vertica, so far we are working with a single node.
Can you please tell me

1) What are the requirements to create multiple nodes?

2) What are the steps of distributing data among those nodes?

Thanks in advance,
Raj
Rajasekhar.T|HP ATP Vertica Big Data Solutions V1

User avatar
becky
Intermediate
Intermediate
Posts: 118
Joined: Sat Apr 28, 2012 11:37 am

Re: Load 100000 files

Post by becky » Sun May 13, 2012 12:50 am

Couldn't the COPY command with wild cards help? See here:

viewtopic.php?f=49&t=172
THANKS - BECKSTER

Post Reply

Return to “Vertica Data Load”