i have:
-set up micronaut-data-processor
-configured an r2dbc datasource in application.yml
-extended ReactorCrudRepository with @R2dbcRepository(dialect = POSTGRES)
but what i get is a missing r2dbcOperations bean which, looking at its code, should be instantiated internally.
what have i missed?
Hi,
I'm trying to use JSON data type to store json data in a specific column. I followed this guide, so saving and reading JSON works but now I get (I have a boolean column as well in a table):
Caused by: org.springframework.core.convert.ConverterNotFoundException: No converter found capable of converting from type [java.lang.Byte] to type [boolean]What can I do??
1 reply
R2dbcCustomConversions bean then JSON doesn't work but I don't get this error...
hey there, did anyone ran into problems using the following stack for the automated testing stage in your ci?
r2dbc + mssql server + junit 5 + testcontainers + github actions
Up front: All tests run locally without any problems or if we swap for a maria db or mysql db with their respective connectors.
When using mssql server: occasionally one or two tests fail in a non reproducible fashion. If rerun, the workflow will most likely run though. We suspect a concurrency problem. however junit is explicitly configured to not use parallel execution. when setting up or clearing test data we wait for the db with .block(), but in the failing case monos or fluxes under test complete without retrieving the testdata.
6 replies
2021-08-05 12:54:21.732 INFO 7144 --- [ main] .TpsPersonalCabinetServiceAppApplication : Started TpsPersonalCabinetServiceAppApplication in 5.819 seconds (JVM running for 6.92)
2021-08-05 12:54:21.734 INFO 7144 --- [ main] o.s.b.a.ApplicationAvailabilityBean : Application availability state LivenessState changed to CORRECT
2021-08-05 12:54:21.735 INFO 7144 --- [ main] o.s.b.a.ApplicationAvailabilityBean : Application availability state ReadinessState changed to ACCEPTING_TRAFFIC
2021-08-05 12:55:14.311 ERROR 7144 --- [actor-tcp-nio-1] a.w.r.e.AbstractErrorWebExceptionHandler : [9c6a9d3a-1] 500 Server Error for HTTP GET "/findbyphonenumber/+111"
org.springframework.core.convert.ConversionFailedException: Failed to convert from type [io.r2dbc.postgresql.PostgresqlRow] to type [java.lang.Boolean] for value 'PostgresqlRow{context=ConnectionContext{client=io.r2dbc.postgresql.client.ReactorNettyClient@7a6e7d77, codecs=io.r2dbc.postgresql.codec.DefaultCodecs@5849c63d, connection=PostgresqlConnection{client=io.r2dbc.postgresql.client.ReactorNettyClient@7a6e7d77, codecs=io.r2dbc.postgresql.codec.DefaultCodecs@5849c63d}, configuration=PostgresqlConnectionConfiguration{applicationName='r2dbc-postgresql', autodetectExtensions='true', compatibilityMode=false, connectTimeout=null, database='intervale', extensions=[], fetchSize=io.r2dbc.postgresql.PostgresqlConnectionConfiguration$Builder$$Lambda$622/0x0000000800e623e0@7fcde469, forceBinary='false', host='10.2.84.132', loopResources='null', options='{search_path=personalcabinet}', password='*********', port=5432, preferAttachedBuffers=false, socket=null, tcpKeepAlive=false, tcpNoDelay=true, username='intervale'}, portalNameSupplier=io.r2dbc.postgresql.DefaultPortalNameSupplier@2f20bd94 .... bla...bla ...blapublic interface UsersRepository extends ReactiveCrudRepository<User, Long> {
@Query("SELECT phone_number FROM personalcabinet.users WHERE phone_number= :phoneNumber")
Mono<Boolean> existsPhoneNumber(String phoneNumber); @GetMapping("/findbyphonenumber/{phoneNumber}")
Mono<Boolean> existsPhoneNumber(@PathVariable String phoneNumber){
return usersRepository.existsPhoneNumber(phoneNumber);
}
org.springframework.dao.DataAccessResourceFailureException: Failed to obtain R2DBC Connection; nested exception is io.r2dbc.spi.R2dbcTransientResourceException: [12514] [08006] Listener refused the connection with the following error:
ORA-12514, TNS:listener does not currently know of service requested in connect descriptor
(CONNECTIONID=T8/zWBdvTgWge+ezncbOUg==)
at org.springframework.r2dbc.connection.ConnectionFactoryUtils.lambda$getConnection$0(ConnectionFactoryUtils.java:88)
Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException:
Error has been observed at the following site(s):
| checkpoint ⇢ Handler com.example.demo.StudentController#getAllTaskStateEnum() [DispatcherHandler]
| checkpoint ⇢ org.springframework.boot.actuate.metrics.web.reactive.server.MetricsWebFilter [DefaultWebFilterChain]
| checkpoint ⇢ HTTP GET "/students/getAllTaskStateEnum" [ExceptionHandlingWebHandler]
SPRING_R2DBC_URL: r2dbc:postgresql://db_app:5432/app? It results in "cannot connect to db_app:5432:5432" help would be very appreciated! I posted more details here https://stackoverflow.com/questions/68571926/r2dbc-connection-port-added-twice-cannot-connect-to-db-app54325432-while-jdb
I am looking for creating a sever which can be connected using jdbc and behave like mysql or postgres server.
Reason to do so is the client is not my code, and that platform will running production env. All I can do is can configure a mysql or postgres servers to pull data.
I have a code which generates data on fly. I want to stream that data to this platform.
I actually have reactive chain like:
- incoming http query (webflux)
- several db queries one by one (r2dbc)
- outgoing http query (webclient)
- several db queries one by one (r2dbc)
- respond with result
I have several thousands rps. Application is fully reactive (no blocking). Most reactive steps are performed on reactor-tcp-epoll threads and I was observing a lot of db connections (200-300) in pending state at that time. Latency of the whole chain is about 200ms.
But if I change scheduler with .publishOn() after every r2dbc call, latency is 50ms and no pending db connections in pool.
I have some update on the problem. I tried to increase load in 1.5 times and noticed increased latency from 50 ms to 300 ms (while CPU utilization was far from 100%) for 5 app instances 4 CPU per instance. BUT changing deployment configuration to 10 instances 2 CPU per instance helps to reduce latency to 50 ms. So the total amount of system resources is the same but latency is affected.
Additionally I discovered that only 1 netty thread is busy - reactor-tcp-epoll-1. Thread-dump of other netty threads is:
java.lang.Thread.State: RUNNABLE
at app//io.netty.channel.epoll.Native.epollWait(Native Method)
....
This can explain why 10x2CPU performes better than 5x4CPU (total size of db connections is the same).
My question is it possible to tune r2dbc or netty to use more netty threads? Thanks in advance.
ok, I'll create ticket.
I also have restored my previous message:
I digged into the problem and found something strange in reactor-netty. While debugging how PostgresqlConnection's channel (->ReactorNettyClient->reactor.netty.Connection->io.netty.Channel) is binded to eventLoop from eventLoopGroup I found that first channel was binded to reactor-tcp-nio-1 (1) but next channels were binded to localLoop which is actually reactor-tcp-nio-1 (2).
reactor.netty.resources.ColocatedEventLoopGroup:
@Override
public EventLoop next() {
if (localLoop.isSet()) {
return localLoop.get(); // (2)
}
return eventLoopGroup.next(); // (1)
}
For test purposes I tried to override class reactor.netty.resources.DefaultLoopResources in my application's classpath with the same class but without wrapping into ColocatedEventLoopGroup.
DefaultLoopResources#cacheNativeClientLoops:
EventLoopGroup cacheNativeClientLoops() {
EventLoopGroup eventLoopGroup = cacheNativeClientLoops.get();
if (null == eventLoopGroup) {
EventLoopGroup newEventLoopGroup = cacheNativeServerLoops(); // LoopResources.colocate(cacheNativeServerLoops());
if (!cacheNativeClientLoops.compareAndSet(null, newEventLoopGroup)) {
// Do not shutdown newEventLoopGroup as this will shutdown the server loops
}
eventLoopGroup = cacheNativeClientLoops();
}
return eventLoopGroup;
}
With this fix all netty reactor-tcp-epoll threads were utilized and performance significantly increased.