Microsoft/vision-ai-developer-kit

Discussing the Vision AI Development Kit

v-prsasa

@v-prsasa

@harishsk Camera doesn't run onnx models but you can run Tensorflow lite models directly

MS-Rameshwar

@v-ragala

@harishsk I hope your issue has been resolved.

martinsipka

@martinsipka

Hi, is there any information on when the Kit becomes available for puchase again?

v-prsasa

@v-prsasa

@martinsipka We are following up internally on the availability of stocks. Will update you shortly

Jan Kubicka

@jkubicka

Vision AI Dev Kit devices are back in stock! Order here: https://azure.github.io/Vision-AI-DevKit-Pages/

AnneTavernier

@AnneTavernier

Hello ! I'm trying to take pictures with the vision ai camera by following this tutorial : https://azure.github.io/Vision-AI-DevKit-Pages/docs/train/ . But indeed it doesn't work. I got an error message on vision studio "ConnectionRefusedError: [WinError 10061]". I don't understand where the problem is. I've checked about access to the port, I've checked the vision ai camera connected, in vs I'm well connected to my Azure account and Python is running well. Any help ? :)

v-prsasa

@v-prsasa

@AnneTavernier Can you try to reset the device once? I am sure it will work.

v-prsasa

@v-prsasa

@AnneTavernier Is your issue resolved?

AnneTavernier

@AnneTavernier

yes it is !

I just don't understand why the code works in run and debugg mode but not in standard running mode

Carlo Q

@luzlab

I saw it mentioned that the Vision AI Kit supports PoE? How does that work? Do I just need to plug in a USB-C to Ethernet adaptor? Is that connection also used for network connectivity?

v-prsasa

@v-prsasa

@luzlab , Hi Carlo,
You can go through the below links as of now we haven't tried to connect in Power over ethernet but this may help you
https://azure.github.io/Vision-AI-DevKit-Pages/docs/Hardware_connections/#connecting-and-verifying-the-usb-connection-to-a-computer
https://azure.github.io/Vision-AI-DevKit-Pages/docs/Cable/

If you are on both ethernet and Wi-Fi attempting to run through device setup on the Vision AI Dev Kit Wi-Fi, and you are not able to connect:

Either disconnect from ethernet before setting up the device and only use the Wi-Fi connection.
Or manually navigate to http://setupaicamera.ms/ after connecting to SoftAP (device access point in Wi-Fi Tray

Carlo Q

@luzlab

I still haven't bought a camera or PoE adaptor - I'm evaluating webcams (with PoE) for a project and I thought I'd ask about this since I've been looking to start using the camera since I heard about it. Do you think this adaptor would work with the camera to provide power and data? The adaptor provides 25W of power (5v/3A, 9V/2A, 12v,1.5A, 15V,1.5A, 20V,1.25A).

Carlo Q

@luzlab

Also, I'm wondering if it's possible to forward the video stream to Azure somehow so that it's viewable from outside a firewall?

v-prsasa

@v-prsasa

I doubt whether it will be viewable from outside firewall

AnneTavernier

@AnneTavernier

Hello ! I have an issue with the soundcard of the camera. I made an ssh connection and execute cat /proc/asound/cards and get a message saying that there is no soundcard ... Any clue ?

MS-Rameshwar

@v-ragala

@AnneTavernier i will check and let you know

AnneTavernier

@AnneTavernier

Okay thanks !

MS-Rameshwar

@v-ragala

@AnneTavernier
What's the firmware version.

v-prsasa

@v-prsasa

@AnneTavernier Are you getting this:

MS-Nikunja

@MS-Nikunja

Hi @AnneTavernier, any update on the above issue?

Pratheek

@Pratheek-Dev

Hello! we're trying to install 3 cameras in a hospital, but we're unable to detect some of the Wi-Fi networks there (we can see them on our PC). There is also the issue where connecting to the network prompts you to an agreement page in which you click agree to terms or type in another code to gain access to the WiFi. Any idea how we can 1) detect all Wifi networks 2) deal the webpage that prompts for an agreement to proceed further?

MS-Nikunja

@MS-Nikunja

Hi @Pratheek-Dev , allow me some time and I will get back to you on this.

Pratheek

@Pratheek-Dev

Thanks @MS-Nikunja . Another questions: I'm trying to run a default TFlite coco object detection model downloaded from the samples link: https://www.tensorflow.org/lite/models/object_detection/overview#starter_model . However, I think my snpe config file not be correct, could you please help me with this: "{
"Engine":0,
"NetworkIO":0,
"ScaleWidth":300,
"ScaleHeight":300,
"PixelNorm":128,
"BlueMean":104,
"GreenMean":117,
"RedMean":123,
"TargetFPS":10,
"ConfThreshold":0.65,
"DLC_NAME":"detect.tflite",
"LABELS_NAME":"labelmap.txt",
"InputLayers":"data_1",
"OutputLayers":["TFLite_Detection_PostProcess","TFLite_Detection_PostProcess:1","TFLite_Detection_PostProcess:2","TFLite_Detection_PostProcess:3"],
"ResultLayers":["TFLite_Detection_PostProcess","TFLite_Detection_PostProcess:1","TFLite_Detection_PostProcess:2","TFLite_Detection_PostProcess:3"],
"Runtime":0

MS-Nikunja

@MS-Nikunja

Sure @Pratheek-Dev . I will get back to you with this one also.

MS-Rameshwar

@v-ragala

@Pratheek-Dev what is firmware version of your camera? can share snapshot?

Pratheek

@Pratheek-Dev

@v-ragala Hi this is the firmware( I've upgraded to latest): v0.5370_Perf

Pratheek

@Pratheek-Dev

Hi @v-ragala to run a Tflite model, what would be the correct config parameters? I've changed the config to this, but without success:{
"FrameworkType":1,
"Engine": 1,
"NetworkIO": 0,
"ScaleWidth": 300,
"ScaleHeight": 300,
"PixelNorm": 0,
"BlueMean": 0,
"GreenMean": 0,
"RedMean": 0,
"TargetFPS": 10,
"ConfThreshold": 0.5,
"DLC_NAME": "",
"LABELS_NAME": "labelmap.txt",
"InputLayers": "normalized_input_image_tensor",
"OutputLayers":["TFLite_Detection_PostProcess","TFLite_Detection_PostProcess:1","TFLite_Detection_PostProcess:2","TFLite_Detection_PostProcess:3"],
"ResultLayers":["TFLite_Detection_PostProcess","TFLite_Detection_PostProcess:1","TFLite_Detection_PostProcess:2","TFLite_Detection_PostProcess:3"],
"Runtime": 0,
"MODEL_FILENAME":"detect.tflite",
"NUM_THREADS":2
}

AnneTavernier

@AnneTavernier

@v-prsasa I did not get this and that was the issue. What s weird is that it has worked once and then on another day it did not. I m working with linux by the way. So i think it s link to the camera and if it doesn t work i restart the camera...

v-prsasa

@v-prsasa

@AnneTavernier Just try to do full factory reset once. It may work then

MS-Rameshwar

@v-ragala

@Pratheek-Dev hey i am confused you are trying to connect camera to your Wi-Fi? and you are having issue after select agreement ?
1) you are trying to connect 3 camera ?
2) you are trying to work on detection module am i right?
so we will go one by one will connect camera then will work on 2nd issue.
1) can you check your camera is connected to your network? could you please go through it https://azure.github.io/Vision-AI-DevKit-Pages/docs/quick_start/
for your 2nd issue of detection module will provide you solution.

Pratheek

@Pratheek-Dev

@v-ragala Hi 1) yes I am trying to install the 3 cameras in a hospital, where they have wifi networks which require you to type in a password into a web browser and agree to their terms/conditions. While on my laptop, I can see the network, join it and a webpage will open asking for the password and agreement checkbox. However, on the Vision AI Camera, I am unable to see that Wifi SSID while configuring the internet, it does not show up on the drop-down list at all. Also, how can we ensure the Vision AI cameras can get to that webpage to type in the password and agreement? Hope this make it clear.

for 2) Object detection using transfer learning: I used this documentation: https://github.com/microsoft/vision-ai-developer-kit/blob/master/machine-learning-notebooks/02-mobilenet-transfer-learning.ipynb. I see the VAM engine is running and a RTSP data stream is created, but not seeing any objects being classified. Could you confirm the sample notebook is working? I trained it on Azure ML workspace with ACI for the build as stated in the notebook. I also tried the basic TFlite model (coco object detection), but I don't think my config file I pasted above is correct? would you be able to take a look and maybe see if there a parameter wrong? are we supposed to put the model into "DLC_NAME" or "MODEL_FILENAME" for TFlite model? I see that the VAM engine accepts TFlite models in addition to DLC?

Appreciate the help - looking forward to a solution!

v-prsasa

@v-prsasa

@Pratheek-Dev 1)When you connect the camera with your PC after all the configuration. From your PC, connect to a Wi-Fi network named MSIOT_xxxxxx (xxxxxx is the last 6 characters of the device’s Wi-Fi MAC address, e.g. MSIOT_BD097D.
And about you query that how to get to that webpage, When you connect to a Wi-Fi(MSIOT_xxxxxx) it will automatically redirect you to the webpage to Configure the camera for your Wi-Fi network.
You can refer to the below link -
https://azure.github.io/Vision-AI-DevKit-Pages/docs/quick_start/#configure-the-camera-for-your-wi-fi-network

v-prsasa

@v-prsasa

@Pratheek-Dev 2) Below there are 3 links which may help you-
https://azure.github.io/Vision-AI-DevKit-Pages/docs/notebookvm/
https://azure.github.io/Vision-AI-DevKit-Pages/docs/azurenotebook/
https://github.com/microsoft/vision-ai-developer-kit/tree/master/samples/research/VisionSample#sample-to-deploy-a-tensorflow-lite-object-detection-model

Pratheek

@Pratheek-Dev

@MS-Nikunja @v-ragala could you please help with the wifi issue? I have no problem connecting to the wifi at home network with the camera, it becomes an issue in corporate setting, where they need us to accept agreement which pops up as a WebPage. @jkubicka

Pratheek

@Pratheek-Dev

@v-prsasa I've elaborated on my question further: At home wifi setting:
At home WiFI I have no trouble connecting the cameras to the internet. I am able to connect to the device and set up the wifi by selecting the WiFi SSID of my network from the http://setupaicamera.ms/ webpage.

While in a corporate Wifi:
I am trying to install the 3 cameras in a hospital, where they have wifi networks which require you to type in a password into a web browser and agree to their terms/conditions. While on my laptop, I can see the network, join it and a webpage will open asking for the password and agreement checkbox. However, on the Vision AI Camera, I am unable to see that Wifi SSID while configuring the internet via http://setupaicamera.ms/, the WiFI SSID not show up on the drop-down list at all. Also, how can we ensure the Vision AI cameras can get to that corporate webpage to click on the agreements? This is similar to most corporate/retail networks, where they expect you to type in a code or agree to terms of service via a browser pop up before being able to access their network. Hope this elaborates further, please help.

v-prsasa

@v-prsasa

@Pratheek-Dev We are looking into it

MS-Rameshwar

@v-ragala

@Pratheek-Dev Thank you for providing more information about the hospital corporate network.
As per your information i got your question. you are able to connect your camera at your home Wi-Fi mean over the broadband connection and when you came into one of the corporate network they have their own private network which is manageable. At your home which is unmanageable network where we can easily connect our camera. In your case we need to take permission from the corporate network admin and then will can connect.
For corporate network will suggest you to take help from their network admin because it’s under their network security policy we can’t help you on this but we can involve our backend dev team so that they can help you regrading this.
@jkubicka As per our discussion can you look into it one of our partner having issue to connect camera to the corporate network.

Pratheek

@Pratheek-Dev

@v-ragala Thanks. Just to add more info: I am able to connect my laptop and phone easily to that hospital network, and then it opens a webpage where we can enter in a passcode and agree to their terms. So this network is for employees only, so it's secure. There is also an open network for patients and guests to use, I can't even connect to that with the camera either as I don't see the wifi SSID on the http://setupaicamera.ms/ wifi drop down list. So basically, can't see both the private and the open network. However, I am able to connect to both networks from both my phone and laptop without problem, so the hospital management/admins are saying its the issue with your hardware. Let me know if I can obtain more information. Thanks everyone for looking into this.

MS-Rameshwar

@v-ragala

@Pratheek-Dev yes, i can understand your query its your partner security issue and in this situation i can only suggest you that you can tell them if it is possible to bypass web authentication for these device if possible. because he disable SSID broadcasting future.
I can only check from dev team if they can help but not sure it will work because its web base authentication enabled only your hospital network admin can help you regarding this.
@jkubicka can you look into it please .

Jan Kubicka

@jkubicka

Hi @Pratheek-Dev Being unable to connect the device to a corporate Wi-Fi network may be due to an existing firewall - you'll need to register the device MAC address with your IT department. The corporate Wi-Fi network should appear in the Wi-Fi drop-down list once it's registered.

Pratheek

@Pratheek-Dev

@jkubicka thanks for the info. Should we continue the discussion here or on GitHub? I can close that issue to avoid redundancy

Jan Kubicka

@jkubicka

@Pratheek-Dev GitHub please :) Let's close the thread here.

Chandra Mohan Rayaprol

@Raysapps

How to program vision AI devkit using Azure IoT SDK? Please suggest.

MS-Nikunja

@MS-Nikunja

@Raysapps Following links may help you out:
https://azure.github.io/Vision-AI-DevKit-Pages/docs/quick_start/#basic-setup
https://azure.github.io/Vision-AI-DevKit-Pages/docs/setup/
https://azure.github.io/Vision-AI-DevKit-Pages/docs/Tutorial-HOL_Using_the_VisionSample/

Chandra Mohan Rayaprol

@Raysapps

@MS-Nikunja I got an understanding of deploying vision AI model on to the device but I am not clear on how to manage the device using IoT Hub SDK. i.e How can I implement/ interact with the device using IoT hub features such as
1 Device to cloud messaging

Cloud to device messaging
Direct method
updating properties in the device twin.
Example: I would like to stop/start camera using a Azure IoT Hub Direct Method.
Please provide/suggest relevant sample code.

v-prsasa

@v-prsasa

@Raysapps Hi Chandra, The below links will help you to understand to manage the device using IoT Hub SDK.
https://azure.github.io/Vision-AI-DevKit-Pages/docs/Setup_Azure_resources/
https://docs.microsoft.com/en-us/azure/iot-hub/about-iot-hub
https://docs.microsoft.com/en-us/azure/iot-hub/iot-hub-devguide-sdks

v-prsasa

@v-prsasa

@Raysapps Hi Chandra, Is the above links helpful to you? Is your issue resolved?

Where communities thrive

People

Repo info

Activity