The project is under massive refactoring currently so please report me any issue I'll be glad to help !
jcrubino
@jcrubino
I am looking at working on two things: A flatfile database for large timeseries and cryptocoin data sources.
For live cryptocoin data sources dir layout I am putting them in intuition/data/cryptos/exchange_name
jcrubino
@jcrubino
actually, I think I am going to create a seperate lib called "coinolith" to access the top 5-10 cryptoexchanges with a uniform api
and then add it to intuition / insights however you think best
My impression (totally up to you) is that the project should be broken up into several focused collections
insight = exploratory analysis
jcrubino
@jcrubino
intuition = trade rules for live data
"recollection" = persistance api (hot trade data = redis, distributed database = rethinkdb, analysis data = a flat db )
jcrubino
@jcrubino
my understanding of the big picture of the project is that it is the backend to a p2p trade execution and analysis platform service
jcrubino
@jcrubino
to be clear I am just putting some thoughts out there so you can correct any misunderstandings I have
before I dig in too deep
It might help to create another collection just for data ingest -> "Slurp" from where all the market api are held
so in general there should be a: market feeds and data collection, persistance / db collection, trade rules collection, exploratory collection and possibly one more being a network - data pipeline that can connect all parts of the project via tcp/http udp zmq
jcrubino
@jcrubino
when I say collection I mean headline repo containing vital apis to the purpose of the collection i.e. intuition, insights etc
that get combined into a cohesive trade execution, analysis and colloboration platform
this being your project where can I be of most help?
jcrubino
@jcrubino
GNATSD http://nats.io/docs/ could serve well as the network messaging layer, bindings for major languages and fast without huge footprint like java
Xavier Bruhiere
@xav-b
Here is how I splitted the project concerns for now :
Intuition holds the skeleton taht glues together every pieces of the system and the APIs used to extend them (data sources, algorithms, portfolio managers and contexts)
and Insights is the place for thoses modules
it seems you take a very data-centric approach to think about the design of the whole and I think it 's great because as the project grows in complexity, it will be more and more difficult to keep every modules within a single repository (i.e. insights)
Xavier Bruhiere
@xav-b
I tried to keep the main execution loop to be kind of "data source agnostic" (algorithms can work in backtesting or live trading mode) and it could be a great idea to begin to think about data provision as a subproject with nice interfaces with the rest of the system
Xavier Bruhiere
@xav-b
As I said I am currently refactoring a lot the repositories so that the core of the project become easier to improve : simpler code, loosely coupled sub-components, data models with validation, distributed and web friendly, ...
I think the best for now would be to focus on "coinolith" (I'm very curious about cryptocurrencies !) and discussing about data sources design, before beginning the implementation starting from the (upcoming !) intuition release 0.5.0
And btw I'm really excited about technologies like p2p trade execution and GNATSD !
jcrubino
@jcrubino
Awesome. Glad to be of help.
Stanley Wu
@shithead548
hi, everyone, this is a really promising project! how to get early access of this project?
Xavier Bruhiere
@xav-b
Hi ctuwuzida ! You can signup here or you can find everything you need to build it yourself on github and the the documentation
For professional reasons I paused temporarily the development so it might break, but I will be glad to help
Xavier Bruhiere
@xav-b
On a side note, I plan a major redesign of the project's underlying architecture. So if this is something you're interested in, it's open for discussion
Kev. Noel
@arita37
Hi
MIchael Epstein
@Kyuba_NoMichi_twitter
Is this offline at moment?
Koo987
@MrKoo987_twitter
hello
anyone here?
Xavier Bruhiere
@xav-b
Hello, I'm afraid the room is pretty empty yes : )
I don't have the time to develop or maintain the project for a while now so it's just in the open for now ; )