Loading sorted data in vertica
Moderator: NorbertKrupa
Loading sorted data in vertica
I have data that is already sorted by primary keys, which I want to load to vertica. Is there anyway to specify that the data is already sorted so that Vertica can make use of that information to make the loads more efficient?
- JimKnicely
- Site Admin
- Posts: 1825
- Joined: Sat Jan 21, 2012 4:58 am
- Contact:
Re: Loading sorted data in vertica
No, there is not a way to tell Vertica not to sort because you have sorted data.
The reasoning behind that is simple. We require that all columns be sorted once they reach the ROS. Vertica cannot risk that the input record set is sorted, even though the user is telling us that it is.
Although, the good news is that if the data is sorted first, it will load faster into the ROS. This is especially true if you have primary key constraint checking turning on (Vertica 8 handles this situation particularly well!)
The reasoning behind that is simple. We require that all columns be sorted once they reach the ROS. Vertica cannot risk that the input record set is sorted, even though the user is telling us that it is.
Although, the good news is that if the data is sorted first, it will load faster into the ROS. This is especially true if you have primary key constraint checking turning on (Vertica 8 handles this situation particularly well!)
Jim Knicely
Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.
Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.