Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Ian Downard
    @ianwow
    image.png
    @rajesh1993 Does that help?
    Rajesh.M
    @rajesh1993
    I will take a look at that. Thanks.
    Wilson Wang
    @opiuman
    The mie cloudformation failed on me with the following error message:
    The following resource(s) failed to create: [MediaconvertOperation, GenericDataLookupOperation, technicalCueDetectionOperation, contentModerationOperation, WebCaptionsOperation, TranscribeOperation, comprehendPhrasesOperation, textDetectionOperation, CreateSRTCaptionsOperation, CreateVTTCaptionsOperation, ThumbnailOperation, contentModerationOperationImage, comprehendEntitiesOperation].
    I built and deployed it from the source. Anyone knows what's happening behind those error message.
    Btw, I was able to deploy it successfully yesterday and I deleted the stack (successfully) and got the error message when I tried to redeploy
    Wilson Wang
    @opiuman
    Verified that the zip and cf files for the operator library are available in the s3 bucket where mie stack is referring to. The error message is really just a statement and didn't tell what caused the failure of those resource creation.
    Ian Downard
    @ianwow
    @opiuman Maybe your prior stack was not completely removed (i.e. the delete failed)? Check to see if there are any Lambda functions or Step Functions left over from your prior stack. If so, manually remove those then try to deploy again.
    1 reply
    Ian Downard
    @ianwow
    The AWS Content Analysis solution was released today. This is the first MIE based solution to be released as an official AWS solution. The Content Analysis solution is designed for video search use cases, and for people who want to test-drive AWS AI services using their own video content.
    Landing page:
    https://aws.amazon.com/solutions/implementations/aws-content-analysis/
    Documentation:
    https://docs.aws.amazon.com/solutions/latest/aws-content-analysis/
    Source Code:
    https://github.com/awslabs/aws-content-analysis
    Rajesh.M
    @rajesh1993
    Nice!
    Ian Downard
    @ianwow
    A blog article was published today describing the AWS Content Analysis application: https://aws.amazon.com/blogs/media/introducing-aws-content-analysis-solution/
    Ian Downard
    @ianwow
    Yesterday we published a blog article summarizing why we built MIE and showcasing some of the applications that use it: https://aws.amazon.com/blogs/media/how-to-rapidly-prototype-multimedia-applications-on-aws-with-the-media-insights-engine/
    Oliver Nordemann
    @olivernordemann
    Hello, I am working in a student project at HPI in Potsdam, Germany. Our task in our project is to develop a pipeline for the automated transcription and translation of videos. We are building an application which integrates different services for transcription and translation. Currently we try to use the aws media insights engine. What is your suggestion to call the aws mie api from our application? How does the authentication work? We are using python with django. We appreciate any help to find a good solution. Thanks a lot!
    Ian Downard
    @ianwow
    @olivernordemann MIE’s api is a REST API, so you interact with it via HTTP requests. Since you’re using python you’ll probably want to use the urllib package to do that. Those calls will include a security token. The IMPLEMENTATION GUIDE shows how to get the token and make HTTP requests: https://github.com/awslabs/aws-media-insights-engine/blob/master/IMPLEMENTATION_GUIDE.md#obtain-a-cognito-token
    Marc Rudkowski
    @marcrd
    is there a way to configure an already existing set of frames/video, and not use the UI as an entry point? eg if we have frames partitioned in a specific way
    Ian Downard
    @ianwow
    @marcd I don’t understand. Are you asking whether its possible to input a video with missing frames?
    Marc Rudkowski
    @marcrd

    No, let's say I have a set of videos I've already broken down into frames, that have a specific partition structure, eg:

    s3://my-path/parent_id={}/child_id={}

    Where the parent_id holds a set frames partitioned by a specific set of ID's. This is for performance reasons doing sagemaker inference (if I uploaded a 25 minute video and tried to do inference on all the frames, that would be very time consuming without splitting the jobs parallel)

    The frames will match the video, its just partitioned in a specific way for performance and metadata labeling reasons
    the parent ID would be corresponding to a specific video
    Ian Downard
    @ianwow
    I think you’ll need to implement your own frame partitioning operator. I’ve heard of several instances where people have built an operator to downsample a video into some small set of frames, but noone has contributed a PR to bring that into the main MIE repo yet.
    Marc Rudkowski
    @marcrd
    Okay that makes sense. Another question: Is there an operator that takes video and converts into frames?
    I see the ability to specify images as an input, but nowhere where the data plane outputs frames
    Ian Downard
    @ianwow
    Not really. The mediaconvert operator extracts a frame for a thumbnail, but I think the MediaConvert services only intends for that to be used for a small number of frames.
    Marc Rudkowski
    @marcrd
    So can the input object be a set of frames within the operator command? eg "Input":{"Media":{"Images"...
    and just point to the prefix with the images
    Ian Downard
    @ianwow
    Yes, you can input images. The rekognition operators already support images as input, so you should be able to look at them to see how to process an image input.
    Marc Rudkowski
    @marcrd
    Okay, thanks, that what I thought, since I saw it in the Rekognition operator, but didn't see image input referenced in deploying an operator
    Ian Downard
    @ianwow
    Marc Rudkowski
    @marcrd
    For custom operators, once you build them, do you need to run the whole CF template again to use them?
    2 replies
    or is there a way to easily add them to an existing solution? was a bit unclear with that
    Ian Downard
    @ianwow
    You’ll need to run the build script and redeploy the CF template because the workflow definitions won’t know about your new lambda function until you redploy.
    Marc Rudkowski
    @marcrd
    once the operators exist though resource wise, you can iterate with them inline with the console once the solution has context right?
    Ian Downard
    @ianwow
    Yes.
    Oliver Nordemann
    @olivernordemann

    Hello, i want to use the MIE API to execute a workflow with a video which is in S3 and I get a 500. How should the media object be specified?

    I use the following Code:
    headers = {"Content-Type": "application/json", "Authorization": IdToken}
    response = http.request('POST', workflow_api_endpoint+'workflow/execution', body=data.encode('utf-8'), headers=headers)
    json.loads(response.data.decode('utf-8'))

    {'Code': 'ChaliceViewError',
    'Message': "ChaliceViewError: Exception ''S3Bucket''"}

    {
    ...,
    "Input":
    {"Media":
    {"Video":
    {"S3Bucket": "mie-dataplane-1yk436e309xh",
    "S3Key":"Man_weiß_et_nich-TV_total_Nippel.mp4"}
    }
    }
    }

    1 reply
    Marc Rudkowski
    @marcrd
    Is there a way to make sure the operators when referencing their path via S3 doesn't actually move the video, but just copies it?
    1 reply
    leochan2009
    @leochan2009
    Hi, everyone, i was following the instruction on the website: https://github.com/awslabs/aws-media-insights-engine/blob/master/IMPLEMENTATION_GUIDE.md
    and tried to deploy my own stack. the stacks were created successfully, however, the access to the webapp url is denied. When i look into the S3 bucket of the webapplication, there is no index.html file inside. The access deny was logged in the S3 bucket when i try to access the webapplication
    9 replies
    leochan2009
    @leochan2009
    Hi Ian,
    Another questions i have is that if the media insight engine supports user interaction with video data. for example, tagging individual frame and save the tagging information in S3? the sagemaker ground truth service is able to do this kind of task. however, the UI is kind of primitive in sagemaker and i would like to design a labeling tool using media insights engine. Thanks in advance
    3 replies
    leochan2009
    @leochan2009

    In the https://github.com/awslabs/aws-media-insights-engine/blob/master/IMPLEMENTATION_GUIDE.md
    Obtain a Cognito Token
    First define the following environment variables. MIE_USERNAME and MIE_PASSWORD should have been emailed to the email address you specified when you deployed the stack. MIE_DEVELOPMENT_HOME should be the path to your aws-media-insights-engine/ development environment, such as /Users/myuser/development/aws-media-insights-engine/.

    The MIE_DEVELOPMENT_HOME should be set to "/Users/myuser/development/aws-media-insights-engine/source" instead

    jimmalone
    @jimmalone
    Hello, I deployed the MIE app to AWS successfully but unable to upload any audio files (wav, mp3). When dragging/dropping audio files in Upload page, I get an error "Unsupported file type: audio/wav". Per the github readme "The Media Insights sample application lets you upload videos, images, audio and text files for content analysis", i should be able to upload audio only file, no?
    2 replies
    Marc Rudkowski
    @marcrd
    Is there a way to skip the stage Execute Polly (defaultTextSynthesisStage)
    1 reply
    I tried this: "defaultTextSynthesisStage":{"Polly":{"Enabled":false}} with no avail
    Ian Downard
    @ianwow
    Media Insights Engine version 1.0.0 was released today. This release improves the developer experience with a simplified MIE code base, easier installations, and support for AWS_IAM.
    The reference front-end application for MIE was also release today, here.
    Ian Downard
    @ianwow

    We’ve developed a new application for transcribing and translating videos, using MIE. This new app enables users to control the tunable parameters in Transcribe and Translate. If you'd like to learn more about this application, register for the following webinar:

    Oct 29, 2020 10:00 AM - 11:30 AM PDT, "Session 1: “Artificial” AI: Improving Subtitles with Human in-the-Loop Review".

    Ian Downard
    @ianwow
    v1.0.2 of the AWS Content Analysis solution was released today. It includes support for mxf video formats and a handfull of important bug fixes.
    Landing page:
    https://aws.amazon.com/solutions/implementations/aws-content-analysis/
    Documentation:
    https://docs.aws.amazon.com/solutions/latest/aws-content-analysis/
    Source Code:
    https://github.com/awslabs/aws-content-analysise
    Changelog:
    https://github.com/awslabs/aws-content-analysis/blob/main/CHANGELOG.md
    Ian Downard
    @ianwow
    MIE 2.0.0 was released today. https://github.com/awslabs/aws-media-insights-engine/releases/tag/v2.0.0
    Notable new features:
    1. support for multiple deployments in one region
    2. debug tracing via AWS X-Ray
    3. standardized test scripts for unit, integration, and end to end tests. See, https://github.com/awslabs/aws-media-insights-engine/blob/master/test/README.md
    Brandon Dold
    @brandold

    MIE 2.0.1 was released today.

    https://github.com/awslabs/aws-media-insights-engine/releases/tag/v2.0.1

    This release introduces the ability to support human in the loop subtitle generation and editing workflows along with new mechanisms for performing automated builds, testing, and releases for faster release cycles. You can find additional details in the release notes.

    Ian Downard
    @ianwow

    MIE 2.0.2 was released today.

    https://github.com/awslabs/aws-media-insights-engine/releases/tag/v2.0.2

    This release includes bug fixes and developer usability improvements, such as:

    • simpler command line usage of the build script with named parameters,
    • MIE / API versions returned via a new API route and as a Cloudformation Output,
    • and tagging of all MIE resources.

    We also have a new Github pages site that contains API reference documentation:

    https://awslabs.github.io/aws-media-insights-engine/

    jimthebuilder
    @jimthebuilder
    Hi. It looks like the Implementation Guide link in the repo is broken.
    Ian Downard
    @ianwow
    @jimthebuilder Thanks! I fixed the broken link.
    jimthebuilder
    @jimthebuilder
    Thank you.