- CDC stream from DynamoDB
- Notify Lambda function that new data was created. This Lambda loads metadata from json files in s3 (reminder: lots of MIE operators save metadata as json files in s3, then put the path to said file in dynamodb), then reformats those json records in a format that Elasticsearch likes (e.g. it’ll flatten nested json arrays because Elasticsearch doesn’t search well over nested arrays)
- This is a hypothetical line. You can use the same kinesis stream endpoints to publish to a new lambda that feeds data into another data store. We use Elasticsearch for the MIE webapp, but as this diagram suggests, you can use this same architectural pattern to populate another data store, e.g. like a graph DB to facilitate some kind of new app for graphing relationships in metadata.
The following resource(s) failed to create: [MediaconvertOperation, GenericDataLookupOperation, technicalCueDetectionOperation, contentModerationOperation, WebCaptionsOperation, TranscribeOperation, comprehendPhrasesOperation, textDetectionOperation, CreateSRTCaptionsOperation, CreateVTTCaptionsOperation, ThumbnailOperation, contentModerationOperationImage, comprehendEntitiesOperation].I built and deployed it from the source. Anyone knows what's happening behind those error message.
Btw, I was able to deploy it successfully yesterday and I deleted the stack (successfully) and got the error message when I tried to redeploy
Landing page:
https://aws.amazon.com/solutions/implementations/aws-content-analysis/
Documentation:
https://docs.aws.amazon.com/solutions/latest/aws-content-analysis/
Source Code:
https://github.com/awslabs/aws-content-analysis
No, let's say I have a set of videos I've already broken down into frames, that have a specific partition structure, eg:
s3://my-path/parent_id={}/child_id={}
Where the parent_id holds a set frames partitioned by a specific set of ID's. This is for performance reasons doing sagemaker inference (if I uploaded a 25 minute video and tried to do inference on all the frames, that would be very time consuming without splitting the jobs parallel)
Hello, i want to use the MIE API to execute a workflow with a video which is in S3 and I get a 500. How should the media object be specified?
I use the following Code:
headers = {"Content-Type": "application/json", "Authorization": IdToken}
response = http.request('POST', workflow_api_endpoint+'workflow/execution', body=data.encode('utf-8'), headers=headers)
json.loads(response.data.decode('utf-8'))
{'Code': 'ChaliceViewError',
'Message': "ChaliceViewError: Exception ''S3Bucket''"}
{
...,
"Input":
{"Media":
{"Video":
{"S3Bucket": "mie-dataplane-1yk436e309xh",
"S3Key":"Man_weiß_et_nich-TV_total_Nippel.mp4"}
}
}
}
1 reply
and tried to deploy my own stack. the stacks were created successfully, however, the access to the webapp url is denied. When i look into the S3 bucket of the webapplication, there is no index.html file inside. The access deny was logged in the S3 bucket when i try to access the webapplication
9 replies
Another questions i have is that if the media insight engine supports user interaction with video data. for example, tagging individual frame and save the tagging information in S3? the sagemaker ground truth service is able to do this kind of task. however, the UI is kind of primitive in sagemaker and i would like to design a labeling tool using media insights engine. Thanks in advance
3 replies
In the https://github.com/awslabs/aws-media-insights-engine/blob/master/IMPLEMENTATION_GUIDE.md
Obtain a Cognito Token
First define the following environment variables. MIE_USERNAME and MIE_PASSWORD should have been emailed to the email address you specified when you deployed the stack. MIE_DEVELOPMENT_HOME should be the path to your aws-media-insights-engine/ development environment, such as /Users/myuser/development/aws-media-insights-engine/.
The MIE_DEVELOPMENT_HOME should be set to "/Users/myuser/development/aws-media-insights-engine/source" instead
2 replies