I wrote a transform udf , and when I use it , I found it is so slowly , and seen like not execute parallizing.
My machine have 8 cores, but when i run my sql with udf, most of the cpu core seems not been runing.
please help.
How can I execute my UDF paralliazing
Moderator: NorbertKrupa
Re: How can I execute my UDF paralliazing
Hi!
Not enough info, at least can you describe what it do, type of function (Scalar/Aggregate/Analytic/Transform), language (Python/Java/C++/R)? For example R do not supports parallelization (functions with recursion too). Also it can be a problem in implementation, so source code is also required.
Regards.
Not enough info, at least can you describe what it do, type of function (Scalar/Aggregate/Analytic/Transform), language (Python/Java/C++/R)? For example R do not supports parallelization (functions with recursion too). Also it can be a problem in implementation, so source code is also required.
Regards.