Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    tduval-xtensible
    @tduval-xtensible
    we're generating mappings through automation we want to import in bulk to the tool and then have someone go in manually after to map the items not picked up through automation
    it'd be great if you published the schema for the internal .json file with each release and gave us the ability to import mappings in bulk. muy productivity enhancer!
    we'll be branching the code soon and persisting mappings in a graph store real time rather than stateful saves like .adm...
    but still it'd be a great feature!
    Paul Leacu
    @pleacu
    I'll bounce it off of the other engineers...
    tduval-xtensible
    @tduval-xtensible
    Danka
    Paul Leacu
    @pleacu
    Bitte Schon
    tduval-xtensible
    @tduval-xtensible
    oh to answer @riccardo-forina , we're using it as a front end for capturing data lineage
    MartyStache
    @MartyStache
    What operating system would you recommend to deploy and run AtlasMap to support ~20 users?
    Best on Windows or Linux?
    Are there any recommended systems requirements? Processor/Memory? Is that somewhere in UserGuide?
    MartyStache
    @MartyStache
    also, can someone point me to where in the dev/user guide the documentation is for "and then run that data mapping via runtime engine" (not camel, the plain Java API)
    image.png
    Tomohisa Igarashi
    @igarashitm
    @MartyStache AtlasMap design time backend instance is not supposed to be shared with multiple users, there's no session management. More people are using on Linux and some are on Mac, also I saw a few people using windows
    Andrey Filippov
    @andreessen
    Hello all. Could somebody please help me with a simple mapping? There is initial json input schema (actually same as the output one):
    { "$schema": "http://json-schema.org/schema#", "title": "Product", "description": "A product from Acme's catalog", "type": "object", "properties": { "productId": { "description": "The unique identifier for a product", "type": "integer" }, "productName": { "description": "Name of the product", "type": "string" }, "price": { "description": "The price of the product", "type": "number", "exclusiveMinimum": 0 } }, "required": [ "productId", "productName", "price" ] }
    I do direct mapping field-to-field and start this transformation inside Camel. My input data is as simple as:
    { "productId": 1, "productName": "An ice sculpture", "price": 12.50 }
    And finally I am getting exception in Camel logs:
    io.atlasmap.api.AtlasException: com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException: Unrecognized field "id" (class io.atlasmap.v2.DataSourceMetadata), not marked as ignorable (8 known properties: "documentType", "documentId", "name", "inspectionType", "dataSourceType", "isSource", "source", "inspectionParameters"])
    at [Source: (GZIPInputStream); line: 11, column: 18] (through reference chain: io.atlasmap.v2.ADMDigest["exportMeta"]->java.lang.Object[][0]->io.atlasmap.v2.DataSourceMetadata["id"])
    What could be wrong?
    tduval-xtensible
    @tduval-xtensible
    Thanks @igarashitm , could you also tell me what dependencies are needed for deploying standalone.jar to a linux box? from the instructions on github, I see yarn
    does mvnw come with a particular installation of java?
    i ask because i did the build on my mac which apparently had everything needed to start the server and run it, so not sure what minimum requirements (e.g., yarn) are
    tduval-xtensible
    @tduval-xtensible
    Oh! Nvm! Figured it out...duh!
    Tomohisa Igarashi
    @igarashitm
    @andreessen sounds like this one - atlasmap/atlasmap#2449 fixed in master
    MartyStache
    @MartyStache
    i am successfully interfacing with REST API though I am running into some issues. I get 403 forbidden when trying DELETE /mapping/RESET/ALL ???
    I have a few sample mappings I did in the UI and I would expect that when I run RESET/ALL, I could refresh the UI and they should be gone
    also, I would like to learn a little more about mappingFormat and mappingDefinitionId
    can I not interact with the API, add mappings, and then refresh the UI and see them added?
    maybe someone can help me (if they have already done this) with a few code samples? or are there any examples you can point me to in the code base that does what I'm after?
    ah and finding AM runs better on linux than windows!
    Tomohisa Igarashi
    @igarashitm
    @MartyStache can you elaborate your question? I don't think there's any example for your usecase, hitting REST API directly
    MartyStache
    @MartyStache
    from what i'm aware of, the REST API was developed to get AtlasMap working in a browser. What I'm doing is writing a client library (to act as if I were the browser) to get MappingFile, add to it, validate it, and then update it (on the server). Here's the sample code I have so far and will contribute the client library when I have it done for others to use (of course, using the REST API as intended). I'm likely doing something wrong that's easily missed. You can see the two outputs to the console below. I get the full document back and immediately attempt to turn it around and validate it and get 403 (which indicates permissions issues?). Like I said, I'm likely doing something obviously wrong, so any help is appreciated!
    image.png
    MartyStache
    @MartyStache
    Also get forbidden in CURL
    image.png
    is this a build configuration issue for the service/server?
    Andrey Filippov
    @andreessen
    @igarashitm Appreciate your help!
    Tomohisa Igarashi
    @igarashitm
    @MartyStache you might want to capture what request body/headers are sent from UI and copy them
    tduval-xtensible
    @tduval-xtensible
    Thanks @igarashitm, will check those and report back. Just noticed there were only tests in AtlasServiceTest and RestTest files for gets and not puts and thought I’d ask
    tduval-xtensible
    @tduval-xtensible
    @igarashitm all I can say about reading those request body and headers is that it was ‘awesome’
    Thanks so much, have it working successfully now
    I will post code when i get it tidy
    Tomohisa Igarashi
    @igarashitm
    cool
    MartyStache
    @MartyStache
    @igarashitm - should I be using updateMapping or processMapping to add new mappings? I've seen both used. When I use updateMapping and my paths are getting truncated from the left which throws everything out of whack. e.g, path "/A/B/@c" is passed in document. After server returns a 200, I refresh the browser and when inspecting the server mapping file, I notice the path has been turned into /B/@c which makes the mapping fall out of its hierarchy (path).
    we've compared the file we're creating to sample files and we aren't finding any differences so we're scratching our heads
    Tomohisa Igarashi
    @igarashitm
    I think it's createMapping and updateMapping
    processMapping is used for mapping preview
    MartyStache
    @MartyStache
    ok...that's what I thought
    but can't explain the truncation and the additional @ characters we get each time we refresh the browser on the properties. @id after one refresh becomes @@id, another refresh, @@@id
    any ideas why the truncation is happening? Everything else is working as documented
    MartyStache
    @MartyStache
    and we get a 200 from validateMapping just prior to calling updateMapping
    Tomohisa Igarashi
    @igarashitm
    no idea about the truncation, duplicated @ would be a bug atlasmap/atlasmap#1518
    MartyStache
    @MartyStache
    ok...#1518 is exactly what we're seeing, thanks for the heads up