http://amberframework.org - Questions? Post on StackOverflow and contribute to community knowledge! https://stackoverflow.com/questions/tagged/amber-framework - IRC? Share your chat messages across http://webchat.freenode.net/?channels=#amber
Hi, I want to implement parallelism like in ruby parallel gem (https://github.com/grosser/parallel)
Parallel.each(User.all, in_processes: 8) do |user|
user.update_attribute(:some_attribute, some_value)
end
In crystal. Any ideas how this can be done in crystal?
I have a database of 20 million dated records on which I need to perform several analysis (50+) and store the results for each analysis and each date back into the database. So executing in parallel processes will save me a lot of time. Thanks.
Parallel.each(User.all, in_processes: 8) do |user|
user.update_attribute(:some_attribute, some_value)
end
In crystal. Any ideas how this can be done in crystal?
I have a database of 20 million dated records on which I need to perform several analysis (50+) and store the results for each analysis and each date back into the database. So executing in parallel processes will save me a lot of time. Thanks.
@damianham when I use that line I get this
Unhandled exception in spawn: Must call subscribe without a subscription block when already inside a subscription loop (Redis::Error)
from lib/redis/src/redis/commands.cr:1661:22 in 'subscribe'
from lib/amber/src/amber/websockets/adapters/redis.cr:25:9 in '->'
from /home/jonathan/.asdf/installs/crystal/1.0.0/share/crystal/src/primitives.cr:255:3 in 'run'
from /home/jonathan/.asdf/installs/crystal/1.0.0/share/crystal/src/fiber.cr:92:34 in '->'
from ???
@mixflame looking at subscribe() in redis/commands.cr:1655 it looks like you can only call this once with a block so you can only subscribe to a single topic because lib/amber/src/amber/websockets/channel.cr#setup_pubsub_adapter:75 sets up the adapter with a String and in your case what you want to do is setup the adapter with an array of String, one for each topic but it looks like you can't do that currently with Amber. A PR to rework the client_socket and channel stuff to handle your use case is called for. I think @drujensen suggested soem tiem ago that this needed some work and I think it was Nick Franken @fridgerator that did the initial implementation.
you can see my process in the pull request
it seems to still drop every 1st message when it subscribes, i worked in the redisadapter code. can you see why my code drops messages? I think it's due to the begin...rescue... resubscribing after setup_pubsub has already been called once. Why is the pubsub setup being called twice?
canvas joined
{"event" => "join", "topic" => "canvas:"}
subscribing to ["canvas", "chat", "persistence", "session"]
chat joined
persistence joined
subscribing to ["canvas", "chat", "persistence", "session"]
Person.all ("FULL OUTER JOIN posts ON posts. person_id = people.id") this code generates a bunch of n+1 requests.
Help. I tried installing Amber via homebrew and it kept on giving me this error.`Unable to satisfy the following requirements:
crystal (>= 0.35.0)required byamber_router 0.4.4crystal (>= 0.34.0, < 2.0.0)required byjson_mapping 0.1.1crystal (>= 0.35.0)required byameba 0.13.4crystal (~> 0.30, >= 0.30.0)required bycli 0.9.3
Failed to resolve dependencies, try updating incompatible shards or use --ignore-crystal-version as a workaround if no update is available.
If reporting this issue please do so at (not Homebrew/brew or Homebrew/core):
https://github.com/amberframework/homebrew-amber/issues
Error: A newer Command Line Tools release is available.
Update them from Software Update in System Preferences or run:
softwareupdate --all --install --force
If that doesn't show you any updates, run:
sudo rm -rf /Library/Developer/CommandLineTools
sudo xcode-select --install
Alternatively, manually download them from:
https://developer.apple.com/download/more/.
You should download the Command Line Tools for Xcode 12.5.`
Hi, I'm quite new to amber (wanna try something else after 4 years of Rails) and I've got a question regarding the validation errors: If I validate for example the user's email and password, how do I rescue the validation errors and show it?
user = User.new user_params.validate! I always get redirected to an Error 500 page
can't you do something like if user.valid? ... else ....
I tried and failed to upgrade amber redis websocket adapter to support multiple channels and failed repeatedly. This is a major feature request tho <3
@elorest ^
check my PR, code should be in there i think... if you wanna try to fix it
none of my approaches resulted in reliable 5 channel subscription streaming
mixflame/amber has it
it's alive!!!!
redis adapter will subscribe once per application lifetime
to all channels
no config changes
just enable the redis adapter and get multichannel support
custom redis web socket adapter... gl and enjoy.. made with love for Amber from Jon
ok... looks like two processes will work with port_reuse disabled...
I noticed a Race condition in my design... the subscribe still doesn't happen early enough, websocket channels can be joined before the subscribe completes. Maybe Amber is faster than Redis? I simply disabled the patch in my code but the patch still stands. The subscribe simply needs to happen faster or wait until its completed.