Adding more nodes to current cluster

Moderator: NorbertKrupa

Post Reply
weikang
Newbie
Newbie
Posts: 16
Joined: Thu Sep 25, 2014 12:06 am

Adding more nodes to current cluster

Post by weikang » Wed Nov 19, 2014 8:31 pm

We have a 20-nodes cluster on AWS; we are planning to add another 20-nodes. We have two options: 1. build another cluster and separate tables into two clusters; 2. add into current cluster and do rebalance (We have 1.2TB data in each node of 2.6TB max).

Any recommendations? Thanks.

NorbertKrupa
GURU
GURU
Posts: 527
Joined: Tue Oct 22, 2013 9:36 pm
Location: Chicago, IL
Contact:

Re: Adding more nodes to current cluster

Post by NorbertKrupa » Wed Nov 19, 2014 9:06 pm

Depends on your business requirements. Would you use this as a production cluster, or for DR?

Without knowing much details, it's hard to say. However, having two separate clusters would make more sense from the high availability standpoint.
Checkout vertica.tips for more Vertica resources.

scutter
Master
Master
Posts: 302
Joined: Tue Aug 07, 2012 2:15 am

Re: Adding more nodes to current cluster

Post by scutter » Wed Nov 19, 2014 10:23 pm

Agreeing with Norbert that it depends on your business requirements.

What are the current performance characteristics of your current cluster? Are your CPUs maxed out, do you have iowait? How is individual query performance versus your SLA? Doubling the size of the cluster will result in 2x the query speed in general.
Sharon Cutter
Vertica Consultant, Zazz Technologies LLC

weikang
Newbie
Newbie
Posts: 16
Joined: Thu Sep 25, 2014 12:06 am

Re: Adding more nodes to current cluster

Post by weikang » Wed Nov 19, 2014 11:42 pm

Thanks for your replies!

Our data size increases dramatically and we are expecting more increase during holiday season. So We are planning to distribute data to more nodes.

Today, we are loading aggregated data from netezza. We are considering loading from log servers into Vertica directly.

NorbertKrupa
GURU
GURU
Posts: 527
Joined: Tue Oct 22, 2013 9:36 pm
Location: Chicago, IL
Contact:

Re: Adding more nodes to current cluster

Post by NorbertKrupa » Thu Nov 20, 2014 3:00 pm

weikang wrote:Our data size increases dramatically and we are expecting more increase during holiday season. So We are planning to distribute data to more nodes.
So there's a requirement to have this data active and not moved off to long term storage?
Checkout vertica.tips for more Vertica resources.

weikang
Newbie
Newbie
Posts: 16
Joined: Thu Sep 25, 2014 12:06 am

Re: Adding more nodes to current cluster

Post by weikang » Thu Nov 20, 2014 7:22 pm

Hi norbertk,

yes, we are expecting to handling larger size of data.

NorbertKrupa
GURU
GURU
Posts: 527
Joined: Tue Oct 22, 2013 9:36 pm
Location: Chicago, IL
Contact:

Re: Adding more nodes to current cluster

Post by NorbertKrupa » Fri Nov 21, 2014 3:40 am

weikang wrote:yes, we are expecting to handling larger size of data.
Have you estimated the expected growth and thus came up with 20 nodes?
Checkout vertica.tips for more Vertica resources.

Post Reply

Return to “New to Vertica”