How to push the data for Vertica Database ?

Moderator: NorbertKrupa

jerald
Newbie
Newbie
Posts: 7
Joined: Wed Nov 12, 2014 11:59 am

How to push the data for Vertica Database ?

Post by jerald » Mon Nov 17, 2014 6:19 am

Hi,
i'm new bee to vertica database. In Oracle using listener we can push the data from database.

In vertica is there possibility to push the data from database.

User avatar
BoMBaY
Beginner
Beginner
Posts: 26
Joined: Tue Jul 16, 2013 5:45 am

Re: How to push the data for Vertica Database ?

Post by BoMBaY » Mon Nov 17, 2014 8:10 am

Oracle Net Listener is a separate process that runs on the database server computer. It receives incoming client connection requests and manages the traffic of these requests to the database server.

https://docs.oracle.com/cd/E11882_01/ne ... nercfg.htm

I'm not sure what you mean by "push the data from database via listener".

If you mean spool data from Oracle database via sqlplus. For Vertica you can use \o via vsql.

If I miss understand, Can you explain more or show me an example.
Itipong Chewinpipat (Bay)
DBA Specialist (Vertica/Oracle)

Image
ImageImage

jerald
Newbie
Newbie
Posts: 7
Joined: Wed Nov 12, 2014 11:59 am

Re: How to push the data for Vertica Database ?

Post by jerald » Tue Nov 18, 2014 6:56 am

Thanks for replying.

I am looking at a design where I run a Java program which listens to vertica database table changes (namely DML statements) and get notifications in my Java program. I have done a similar design for oracle database using "Database Change Listener" and hoping to implement a similar design for vertica database.

Hope this is clear.

NorbertKrupa
GURU
GURU
Posts: 527
Joined: Tue Oct 22, 2013 9:36 pm
Location: Chicago, IL
Contact:

Re: How to push the data for Vertica Database ?

Post by NorbertKrupa » Tue Nov 18, 2014 2:52 pm

When you say table changes, do you mean the actual data or the table structure? If the former, then you should use some sort of sequence.
Checkout vertica.tips for more Vertica resources.

User avatar
JimKnicely
Site Admin
Site Admin
Posts: 1825
Joined: Sat Jan 21, 2012 4:58 am
Contact:

Re: How to push the data for Vertica Database ?

Post by JimKnicely » Tue Nov 18, 2014 11:32 pm

Maybe monitor the v_monitor.query_requests table looking for DML?

Something like this, but maybe a little more robust depending in the requirements...

Code: Select all

select request from v_monitor.query_requests where request ilike 'insert%' or request ilike '%update' or request ilike '%delete' and start_timestamp > [[time last checked]];
Jim Knicely

Image

Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.

jerald
Newbie
Newbie
Posts: 7
Joined: Wed Nov 12, 2014 11:59 am

Re: How to push the data for Vertica Database ?

Post by jerald » Wed Nov 19, 2014 5:58 am

This approach will require polling the mentioned table at regular intervals to find out the data changes. What I am looking for is some sort of notification (as close as realtime) in the Java layer, as soon as a record is inserted/updated/deleted. I am trying to figure out, if there is any approach in Vertica database similar to "Database Change Listener" for Oracle.

User avatar
JimKnicely
Site Admin
Site Admin
Posts: 1825
Joined: Sat Jan 21, 2012 4:58 am
Contact:

Re: How to push the data for Vertica Database ?

Post by JimKnicely » Wed Nov 19, 2014 1:15 pm

I am unaware of anything in Vertica that will "automatically" push data to a destination. I'm not sure why you'd ever want that.

Don't forget that Vertica is a analytics database, not an OLTP. How are you updating Vertica? What ever process that is (i.e. an ETL tool) why not have that process also send the inserts, updates and/or deletes to whatever other destination you need?
Jim Knicely

Image

Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.

Post Reply

Return to “New to Vertica”