HotswapProjects/user

Graziano Felline

@ogipogi

Thank you Vladimir,
i will now check the instructions from https://github.com/HotswapProjects/hotswap-docklands.
I want run this setup on OSX, do you know if this setup works there?

Vladimir Dvorak

@skybber

OSX should be OK

btw, did you try last dcevm :) ?

Graziano Felline

@ogipogi

yes

Graziano Felline

@ogipogi

hmm, i check the config and it looks like my config i have.

It looks like the hotswap-agent.propertiesfile is not recognized.

Do you know if i need the JBossModules plugin for EAP 7.2?

Vladimir Dvorak

@skybber

May be the missing plugin is the problem https://github.com/HotswapProjects/HotswapAgent/tree/master/plugin/hotswap-agent-jbossmodules-plugin

Vladimir Dvorak

@skybber

jbossmodules plugin was not updated for a long time, I tried to fix it in new https://github.com/HotswapProjects/HotswapAgent/releases/tag/1.4.2-SNAPSHOT

Could you check it please for EAP 7.2?

Graziano Felline

@ogipogi

Thank you very much for your help.

I get still an exception, but an other one:

Formatter ##CONSOLE-FORMATTER## is not defined
HOTSWAP AGENT: 10:28:58.522 INFO (org.hotswap.agent.HotswapAgent) - Loading Hotswap agent {1.4.2-SNAPSHOT} - unlimited runtime class redefinition.
HOTSWAP AGENT: 10:28:59.333 INFO (org.hotswap.agent.config.PluginRegistry) - Discovered plugins: [Hotswapper, WatchResources, AnonymousClassPatch, ClassInitPlugin, JdkPlugin, Proxy, WebObjects, Weld, JBossModules, Undertow]
Listening for transport dt_socket at address: 8787
HOTSWAP AGENT: 10:28:59.481 ERROR (org.hotswap.agent.annotation.handler.PluginClassFileTransformer) - InvocationTargetException in transform method on plugin 'class org.hotswap.agent.plugin.jbossmodules.JBossModulesPlugin' class 'org/jboss/modules/ModuleLoader'.
java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.hotswap.agent.annotation.handler.PluginClassFileTransformer.transform(PluginClassFileTransformer.java:218)
    at org.hotswap.agent.annotation.handler.PluginClassFileTransformer.transform(PluginClassFileTransformer.java:112)
    at org.hotswap.agent.util.HotswapTransformer.transform(HotswapTransformer.java:246)
    at sun.instrument.TransformerManager.transform(TransformerManager.java:188)
    at sun.instrument.InstrumentationImpl.transform(InstrumentationImpl.java:428)
    at org.jboss.modules.DefaultBootModuleLoaderHolder$1.run(DefaultBootModuleLoaderHolder.java:35)
    at org.jboss.modules.DefaultBootModuleLoaderHolder$1.run(DefaultBootModuleLoaderHolder.java:33)
    at java.security.AccessController.doPrivileged(Native Method)
    at org.jboss.modules.DefaultBootModuleLoaderHolder.<clinit>(DefaultBootModuleLoaderHolder.java:33)
    at org.jboss.modules.Main.main(Main.java:391)
Caused by: org.hotswap.agent.javassist.CannotCompileException: [source error] getClassLoaderPrivate() not found in java.lang.String
    at org.hotswap.agent.javassist.CtBehavior.insertBefore(CtBehavior.java:806)
    at org.hotswap.agent.javassist.CtBehavior.insertBefore(CtBehavior.java:766)
    at org.hotswap.agent.plugin.jbossmodules.JBossModulesPlugin.transformModule(JBossModulesPlugin.java:68)
    ... 14 more
Caused by: compile error: getClassLoaderPrivate() not found in java.lang.String
    at org.hotswap.agent.javassist.compiler.TypeChecker.atMethodCallCore(TypeChecker.java:777)
    at org.hotswap.agent.javassist.compiler.TypeChecker.atCallExpr(TypeChecker.java:723)
    at org.hotswap.agent.javassist.compiler.JvstTypeChecker.atCallExpr(JvstTypeChecker.java:170)
    at org.hotswap.agent.javassist.compiler.ast.CallExpr.accept(CallExpr.java:49)
    at org.hotswap.agent.javassist.compiler.JvstTypeChecker.atMethodArgs(JvstTypeChecker.java:235)
    at org.hotswap.agent.javassist.compiler.TypeChecker.atMethodCallCore(TypeChecker.java:763)
    at org.hotswap.agent.javassist.compiler.TypeChecker.atCallExpr(TypeChecker.java:723)
    at org.hotswap.agent.javassist.compiler.JvstTypeChecker.atCallExpr(JvstTypeChecker.java:170)
    at org.hotswap.agent.javassist.compiler.ast.CallExpr.accept(CallExpr.java:49)
    at org.hotswap.agent.javassist.compiler.CodeGen.doTypeCheck(CodeGen.java:266)
    at org.hotswap.agent.javassist.compiler.CodeGen.atStmnt(CodeGen.java:360)
    at org.hotswap.agent.javassist.compiler.ast.Stmnt.accept(Stmnt.java:53)
    at org.hotswap.agent.javassist.compiler.CodeGen.atStmnt(CodeGen.java:381)
    at org.hotswap.agent.javassist.compiler.ast.Stmnt.accept(Stmnt.java:53)
    at org.hotswap.agent.javassist.compiler.CodeGen.atIfStmnt(CodeGen.java:428)
    at org.hotswap.agent.javassist.compiler.CodeGen.atStmnt(CodeGen.java:385)
    at org.hotswap.agent.javassist.compiler.ast.Stmnt.accept(Stmnt.java:53)
    at org.hotswap.agent.javassist.compiler.Javac.compileStmnt(Javac.java:578)
    at org.hotswap.agent.javassist.CtBehavior.insertBefore(CtBehavior.java:786)
    ... 16 more

Exception in thread "main" java.lang.NoClassDefFoundEr

Vladimir Dvorak

@skybber

I've fixed it https://github.com/HotswapProjects/HotswapAgent/releases/tag/1.4.2-SNAPSHOT

Graziano Felline

@ogipogi

After applying the fix i get again the originally `NoClassDefFoundError``

Formatter ##CONSOLE-FORMATTER## is not defined
HOTSWAP AGENT: 12:56:49.703 INFO (org.hotswap.agent.HotswapAgent) - Loading Hotswap agent {1.4.2-SNAPSHOT} - unlimited runtime class redefinition.
HOTSWAP AGENT: 12:56:50.527 INFO (org.hotswap.agent.config.PluginRegistry) - Discovered plugins: [Hotswapper, WatchResources, AnonymousClassPatch, ClassInitPlugin, JdkPlugin, Proxy, WebObjects, Weld, JBossModules, Undertow]
Listening for transport dt_socket at address: 8787
Exception in thread "main" java.lang.NoClassDefFoundError: org/hotswap/agent/util/classloader/HotswapAgentClassLoaderExt
    at org.jboss.modules.Module.<init>(Module.java:247)
    at org.jboss.modules.ModuleLoader$3.run(ModuleLoader.java:729)
    at org.jboss.modules.ModuleLoader$3.run(ModuleLoader.java:724)
    at java.security.AccessController.doPrivileged(Native Method)
    at org.jboss.modules.ModuleLoader.defineModule(ModuleLoader.java:724)
    at org.jboss.modules.ModuleLoader.loadModuleLocal(ModuleLoader.java:531)
    at org.jboss.modules.DelegatingModuleLoader.preloadModule(DelegatingModuleLoader.java:57)
    at org.jboss.modules.ModuleLoader.loadModule(ModuleLoader.java:295)
    at __redirected.__RedirectedUtils.loadProvider(__RedirectedUtils.java:92)
    at __redirected.__RedirectedUtils.loadProvider(__RedirectedUtils.java:86)
    at __redirected.__DocumentBuilderFactory.changeDefaultFactory(__DocumentBuilderFactory.java:53)
    at __redirected.__JAXPRedirected.changeAll(__JAXPRedirected.java:53)
    at org.jboss.modules.Main.main(Main.java:428)

Graziano Felline

@ogipogi

I managed to avoid the NoClassDefFoundError with adding
-Xbootclasspath/p:$JBOSS_HOME/hotswap-agent/hotswap-agent-1.4.2-SNAPSHOT.jar \to JAVA_OPTS

I get now new Exception during deploy of activemq-rar and Camunda Engine that i need to investigate first.

13:29:58,467 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-2) WFLYMSGAMQ0002: Bound messaging object to jndi name java:jboss/DefaultJMSConnectionFactory
13:30:00,040 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-3) MSC000001: Failed to start service jboss.module.service."deployment.activemq-rar.rar".main: org.jboss.msc.service.StartException in service jboss.module.service."deployment.activemq-rar.rar".main: Failed to start service
    at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1731)
    at org.jboss.msc.service.ServiceControllerImpl$ControllerTask.run(ServiceControllerImpl.java:1559)
    at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
    at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
    at org.hotswap.agent.config.PluginRegistry.getPluginClass(PluginRegistry.java:293)
    at org.hotswap.agent.config.PluginRegistry.initializePlugin(PluginRegistry.java:165)
    at org.jboss.modules.ModuleLoader.loadModule(ModuleLoader.java:300)
    at org.jboss.modules.ModuleLoader.loadModule(ModuleLoader.java:283)
    at org.jboss.as.server.moduleservice.ModuleLoadService.start(ModuleLoadService.java:66)
    at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1739)
    at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1701)
    ... 6 more

13:30:00,134 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-8) MSC000001: Failed to start service jboss.module.service."deployment.camunda-webapp-ee-jboss-7.11.11-ee.war".main: org.jboss.msc.service.StartException in service jboss.module.service."deployment.camunda-webapp-ee-jboss-7.11.11-ee.war".main: Failed to start service
    at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1731)
    at org.jboss.msc.service.ServiceControllerImpl$ControllerTask.run(ServiceControllerImpl.java:1559)
    at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
    at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
    at org.hotswap.agent.config.PluginRegistry.getPluginClass(PluginRegistry.java:293)
    at org.hotswap.agent.config.PluginRegistry.initializePlugin(PluginRegistry.java:165)
    at org.jboss.modules.ModuleLoader.loadModule(ModuleLoader.java:300)
    at org.jboss.modules.ModuleLoader.loadModule(ModuleLoader.java:283)
    at org.jboss.as.server.moduleservice.ModuleLoadService.start(ModuleLoadService.java:66)
    at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1739)
    at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1701)
    ... 6 more

The JBossModules plugin is now loaded:

HOTSWAP AGENT: 13:29:53.398 INFO (org.hotswap.agent.config.PluginRegistry) - Discovered plugins: [Hotswapper, WatchResources, AnonymousClassPatch, ClassInitPlugin, JdkPlugin, Owb, Proxy, WebObjects, Weld, JBossModules, Undertow]

I need now to understand this NullPointerException

Caused by: java.lang.NullPointerException
    at org.hotswap.agent.config.PluginRegistry.getPluginClass(PluginRegistry.java:293)

Vladimir Dvorak

@skybber

Probably system class loader is null

Vladimir Dvorak

@skybber

Probably correct version of PluginRegistry.getPluginClass for null bootstrap classloader is:

protected Class<Object> getPluginClass(String pluginClass) {
    try {
        // noinspection unchecked
        if (getClass().getClassLoader() == null) {
            return (Class<Object>) Class.forName(pluginClass, true, null);
        }
        return (Class<Object>) getClass().getClassLoader().loadClass(pluginClass);
    } catch (ClassNotFoundException e) {
        throw new IllegalArgumentException("Plugin class not found " + pluginClass, e);
    }
}

I've never investigated why the bootstrap class loader could be null, since I had never faced to this problem

Graziano Felline

@ogipogi

Thank You Vladimir for the additional infos

Vladimir Dvorak

@skybber

If it fix your problem, we can add the fix to ha-core

Graziano Felline

@ogipogi

I will test this

Vladimir Dvorak

@skybber

thanks

I don't have JbossEAP at all ...

Graziano Felline

@ogipogi

:)
I have problems to build a local SNAPSHOT jar

Vladimir Dvorak

@skybber

OK, I'll prepare it

Graziano Felline

@ogipogi

Thank you very much

Vladimir Dvorak

@skybber

snapshot updated

Graziano Felline

@ogipogi

ok, I'll test it

Vladimir Dvorak

@skybber

btw, you need dcevm11 to build HA

Graziano Felline

@ogipogi

Ahh, that was maybe the issue

Vladimir Dvorak

@skybber

I'm using dcevm11 as system jdk now for a week

https://github.com/TravaOpenJDK/trava-jdk-11-dcevm-staged

Graziano Felline

@ogipogi

I tested it:

activemq is deployed
New exception during deployment of Camunda engine

14:46:08,971 ERROR [org.jboss.msc.service.fail] (ServerService Thread Pool -- 69) MSC000001: Failed to start service jboss.deployment.unit."camunda-webapp-ee-jboss-7.11.11-ee.war".undertow-deployment: org.jboss.msc.service.StartException in service jboss.deployment.unit."camunda-webapp-ee-jboss-7.11.11-ee.war".undertow-deployment: java.lang.NoClassDefFoundError: io/undertow/server/handlers/resource/ResourceManager
    at org.wildfly.extension.undertow.deployment.UndertowDeploymentService$1.run(UndertowDeploymentService.java:81)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
    at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378)
    at java.lang.Thread.run(Thread.java:748)
    at org.jboss.threads.JBossThread.run(JBossThread.java:485)
Caused by: java.lang.NoClassDefFoundError: io/undertow/server/handlers/resource/ResourceManager
    at java.lang.ClassLoader.findBootstrapClass(Native Method)
    at java.lang.ClassLoader.findBootstrapClassOrNull(ClassLoader.java:1009)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:408)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:406)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
    at java.lang.ClassLoader.findSystemClass(ClassLoader.java:998)
    at org.jboss.modules.ConcurrentClassLoader.findSystemClassInternal(ConcurrentClassLoader.java:416)
    at org.jboss.modules.JDKSpecific.getSystemClass(JDKSpecific.java:180)
    at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:395)
    at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:116)
    at io.undertow.servlet.core.DeploymentManagerImpl.deploy(DeploymentManagerImpl.java)
    at org.wildfly.extension.undertow.deployment.UndertowDeploymentService.startContext(UndertowDeploymentService.java:96)
    at org.wildfly.extension.undertow.deployment.UndertowDeploymentService$1.run(UndertowDeploymentService.java:78)
    ... 8 more

I need to investigate what happened

Vladimir Dvorak

@skybber

You can try to disable UndertowPlugin

Graziano Felline

@ogipogi

I'm testing now exactly that :)

Vladimir Dvorak

@skybber

UndertowPlugin is for resource loading

Graziano Felline

@ogipogi

It looks good, the exception disappear.
Thank you very much Vladimir.
I'll test now the hot swapping.

Vladimir Dvorak

@skybber

OK, may be Undertow will be needed

then something is wrong in UndertowTransformer - PrefixingResourceManager is extended from jboss ResourceManager, that is not found at

at org.wildfly.extension.undertow.deployment.UndertowDeploymentService.startContext(UndertowDeploymentService.java:96)

Graziano Felline

@ogipogi

Ok, i get additional Exception during deployment of EAR file, also i need to investigate.

15:02:26,199 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-8) MSC000001: Failed to start service jboss.deployment.unit."app.ear".POST_MODULE: org.jboss.msc.service.StartException in service jboss.deployment.unit."app.ear".POST_MODULE: WFLYSRV0153: Failed to process phase POST_MODULE of deployment "app.ear"
    at org.jboss.as.server.deployment.DeploymentUnitPhaseService.start(DeploymentUnitPhaseService.java:151)
    at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1739)
    at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1701)
    at org.jboss.msc.service.ServiceControllerImpl$ControllerTask.run(ServiceControllerImpl.java:1559)
    at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
    at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.Error: java.lang.NullPointerException
    at org.jboss.as.weld.deployment.BeanDeploymentArchiveImpl.<init>(BeanDeploymentArchiveImpl.java:111)
    at org.jboss.as.weld.deployment.processors.BeanArchiveProcessor$ResourceRootHandler.createExplicitBeanDeploymentArchive(BeanArchiveProcessor.java:347)
    at org.jboss.as.weld.deployment.processors.BeanArchiveProcessor$ResourceRootHandler.processResourceRoot(BeanArchiveProcessor.java:304)
    at org.jboss.as.weld.deployment.processors.BeanArchiveProcessor$ResourceRootHandler.handleResourceRoot(BeanArchiveProcessor.java:237)
    at org.jboss.as.weld.deployment.processors.BeanArchiveProcessor$ResourceRootHandler.access$100(BeanArchiveProcessor.java:206)
    at org.jboss.as.weld.deployment.processors.BeanArchiveProcessor.deploy(BeanArchiveProcessor.java:113)
    at org.jboss.as.server.deployment.DeploymentUnitPhaseService.start(DeploymentUnitPhaseService.java:144)
    ... 8 more
Caused by: java.lang.NullPointerException
    ... 15 more

15:02:26,213 ERROR [org.jboss.as.controller.management-operation] (DeploymentScanner-threads - 1) WFLYCTL0013: Operation ("deploy") failed - address: ([("deployment" => "app.ear")]) - failure description: {"WFLYCTL0080: Failed services" => {"jboss.deployment.unit.\"app.ear\".POST_MODULE" => "WFLYSRV0153: Failed to process phase POST_MODULE of deployment \"app.ear\"
    Caused by: java.lang.Error: java.lang.NullPointerException
    Caused by: java.lang.NullPointerException"}}

During deployment of submodules i get now several new HA Info message from JBossModules plugin, this looks good.

HOTSWAP AGENT: 15:02:25.754 INFO (org.hotswap.agent.config.PluginRegistry) - Plugin 'org.hotswap.agent.plugin.jbossmodules.JBossModulesPlugin' initialized in ClassLoader 'ModuleClassLoader for Module "deployment.app.ear.my-module-a-impl.jar" from Service Module Loader'.

Graziano Felline

@ogipogi

Ok, this errors during deploy of EAR file are related with the last fix ( bootstrap class loader). If i deactivate Undertow and JBossModules i get the same Exception...

Vladimir Dvorak

@skybber

INFO messages are ok

bootstrap fix seem ok for me

have you rest of stack trace - pby there is part related to HA

you can try to disable WeldPlugin too

Graziano Felline

@ogipogi

ok, the exception disappear if i disable also the weld plugin

Vladimir Dvorak

@skybber

We have tests for wilfly up to 3.1.3
https://github.com/HotswapProjects/HotswapAgent/blob/master/plugin/hotswap-agent-weld-plugin/run-tests.sh#L79

But not in EAP

Graziano Felline

@ogipogi

ok, thank you for the info

Vladimir Dvorak

@skybber

not at all, hope it helps you

Where communities thrive

People

Repo info

Activity