2.7.0 ML: blas NoClassDefFoundError exception

classic Classic list List threaded Threaded
4 messages Options
mahesh76private mahesh76private
Reply | Threaded
Open this post in threaded view
|

2.7.0 ML: blas NoClassDefFoundError exception

Hi,

How do I need to install BLAS libraries on Server node side?
Should I just place then in libs folder?

THe below error occurs when I run the test examples.



Caused by: java.lang.NoClassDefFoundError: org/netlib/blas/Dnrm2
        at com.github.fommil.netlib.F2jBLAS.dnrm2(F2jBLAS.java:121)
        at
org.apache.ignite.ml.math.isolve.lsqr.LSQROnHeap.lambda$bnorm$7b55d622$1(LSQROnHeap.java:53)
        at
org.apache.ignite.ml.dataset.Dataset.lambda$computeWithCtx$96d91738$1(Dataset.java:143)
        at
org.apache.ignite.ml.dataset.impl.cache.CacheBasedDataset.lambda$computeWithCtx$62946a87$1(CacheBasedDataset.java:112)
        at
org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils.lambda$affinityCallWithRetries$b46c4136$1(ComputeUtils.java:90)
        at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1855)
        at
org.apache.ignite.internal.processors.job.GridJobWorker$2.call(GridJobWorker.java:568)
        at
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6816)
        at
org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:562)
        ... 11 more



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
dmitrievanthony dmitrievanthony
Reply | Threaded
Open this post in threaded view
|

Re: 2.7.0 ML: blas NoClassDefFoundError exception

Hi,

I guess you just haven't ML dependencies on the server node. It works fine
for most of Ignite ML classes because of peer-class-loading, but not for
third-party dependencies. If you work with Ignite binaries you could just
copy all jars from "libs/optional/ignite-ml/*.jar" into "libs".

Best regards,
Anton Dmitriev.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
mahesh76private mahesh76private
Reply | Threaded
Open this post in threaded view
|

Re: 2.7.0 ML: blas NoClassDefFoundError exception

Hi,

My understanding till date is that we need to move ignite-ml FOLDER from
optional into libs.


anyways, I also moved JARS straight away
"libs/optional/ignite-ml/*.jar" into "libs". core1.1.2.jar, which seems to
have the BLAS class also exists.

I still get the same error..


Caused by: java.lang.NoClassDefFoundError: org/netlib/blas/Dnrm2
        at com.github.fommil.netlib.F2jBLAS.dnrm2(F2jBLAS.java:121)
        at
org.apache.ignite.ml.math.isolve.lsqr.LSQROnHeap.lambda$bnorm$7b55d622$1(LSQROnHeap.java:53)
        at
org.apache.ignite.ml.dataset.Dataset.lambda$computeWithCtx$96d91738$1(Dataset.java:143)
        at
org.apache.ignite.ml.dataset.impl.cache.CacheBasedDataset.lambda$computeWithCtx$62946a87$1(CacheBasedDataset.java:112)
        at
org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils.lambda$affinityCallWithRetries$b46c4136$1(ComputeUtils.java:90)
        at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1855)
        at
org.apache.ignite.internal.processors.job.GridJobWorker$2.call(GridJobWorker.java:568)
        at
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6816)
        at
org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:562)
        ... 11 more



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Алексей Платонов Алексей Платонов
Reply | Threaded
Open this post in threaded view
|

Re: 2.7.0 ML: blas NoClassDefFoundError exception

Hi,
It seems to be that Ignite modules are configured with excluding transitive dependencies.
I see it in parent/pom.xml in configuration of maven-dependency-plugin section (excludeTransitive=true).
If I override this section in child modules like ignite-ml these dependencies will be added.

I created ticket for this problem: https://issues.apache.org/jira/browse/IGNITE-11241

Best regards,
Alexey Platonov

чт, 7 февр. 2019 г. в 06:43, mahesh76private <[hidden email]>:
Hi,

My understanding till date is that we need to move ignite-ml FOLDER from
optional into libs.


anyways, I also moved JARS straight away
"libs/optional/ignite-ml/*.jar" into "libs". core1.1.2.jar, which seems to
have the BLAS class also exists.

I still get the same error..


Caused by: java.lang.NoClassDefFoundError: org/netlib/blas/Dnrm2
        at com.github.fommil.netlib.F2jBLAS.dnrm2(F2jBLAS.java:121)
        at
org.apache.ignite.ml.math.isolve.lsqr.LSQROnHeap.lambda$bnorm$7b55d622$1(LSQROnHeap.java:53)
        at
org.apache.ignite.ml.dataset.Dataset.lambda$computeWithCtx$96d91738$1(Dataset.java:143)
        at
org.apache.ignite.ml.dataset.impl.cache.CacheBasedDataset.lambda$computeWithCtx$62946a87$1(CacheBasedDataset.java:112)
        at
org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils.lambda$affinityCallWithRetries$b46c4136$1(ComputeUtils.java:90)
        at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1855)
        at
org.apache.ignite.internal.processors.job.GridJobWorker$2.call(GridJobWorker.java:568)
        at
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6816)
        at
org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:562)
        ... 11 more



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/