embedded-javascript/moddable

Discuss using the Moddable SDK

Daniel Ashcraft

@dashcraft

different error,

esp-windows-curses; sys_platform == 'win32'
To install the missing packages, please run "C:\Users\danie\esp32\esp-idf\install.bat"
Diagnostic information:
    IDF_PYTHON_ENV_PATH: C:\Users\danie\AppData\Local\Programs\Python\Python39\
    Python interpreter used: C:\Users\danie\AppData\Local\Programs\Python\Python39\python.exe

ESP-IDF v4.2.1-141-g1e3638390-dirty
NMAKE : fatal error U1077: 'python' : return code '0x1'
Stop.

i ran the install.bat file, i'm not sure why it's not finding it

Andy Carle

@PrototypingAndy_twitter

When you start up the ESP-IDF command prompt, you should get some diagnostic information. Mine looks like this:

Using Python in C:\Users\andyc\AppData\Local\Programs\Python\Python37\
Python 3.7.3
Using Git in C:\Program Files\Git\cmd\
git version 2.24.1.windows.2
Setting IDF_PATH: C:\Users\andyc\esp32\esp-idf

Adding ESP-IDF tools to PATH...
Not using an unsupported version of tool xtensa-esp32-elf found in PATH: 1.22.0-80-g6c4433a5-5.2.0.
Not using an unsupported version of tool esp32ulp-elf found in PATH: 2.28.51.20170517.
Not using an unsupported version of tool cmake found in PATH: 3.17.0.
Not using an unsupported version of tool openocd-esp32 found in PATH: 0.10.0-dev.
Not using an unsupported version of tool ninja found in PATH: 1.8.2.
    C:\Users\andyc\.espressif\tools\xtensa-esp32-elf\esp-2020r3-8.4.0\xtensa-esp32-elf\bin
    C:\Users\andyc\.espressif\tools\xtensa-esp32s2-elf\esp-2020r3-8.4.0\xtensa-esp32s2-elf\bin
    C:\Users\andyc\.espressif\tools\esp32ulp-elf\2.28.51-esp-20191205\esp32ulp-elf-binutils\bin
    C:\Users\andyc\.espressif\tools\esp32s2ulp-elf\2.28.51-esp-20191205\esp32s2ulp-elf-binutils\bin
    C:\Users\andyc\.espressif\tools\cmake\3.16.4\bin
    C:\Users\andyc\.espressif\tools\openocd-esp32\v0.10.0-esp32-20200709\openocd-esp32\bin
    C:\Users\andyc\.espressif\tools\ninja\1.10.0\
    C:\Users\andyc\.espressif\tools\idf-exe\1.0.1\
    C:\Users\andyc\.espressif\tools\ccache\3.7\
    C:\Users\andyc\.espressif\tools\dfu-util\0.9\dfu-util-0.9-win64
    C:\Users\andyc\.espressif\python_env\idf4.2_py3.7_env\Scripts

Checking if Python packages are up to date...
Python requirements from C:\Users\andyc\esp32\esp-idf\requirements.txt are satisfied.

Done! You can now compile ESP-IDF projects.
Go to the project directory and run:

  idf.py build

Similar to what you're seeing?

Daniel Ashcraft

@dashcraft

I’ll print mine in just a few minutes to be sure, but that looks very similar yes

Daniel Ashcraft

@dashcraft

Setting PYTHONNOUSERSITE, was not set
Using Python in C:/Users/danie/.espressif/python_env/idf4.2_py3.8_env/Scripts
Python 3.8.7
Using Git in C:/Users/danie/.espressif/tools/idf-git/2.30.1/cmd
git version 2.30.1.windows.1
Setting IDF_PATH: C:\Users\danie\esp32

Adding ESP-IDF tools to PATH...
    C:\Users\danie\.espressif\tools\xtensa-esp32-elf\esp-2020r3-8.4.0\xtensa-esp32-elf\bin
    C:\Users\danie\.espressif\tools\xtensa-esp32s2-elf\esp-2020r3-8.4.0\xtensa-esp32s2-elf\bin
    C:\Users\danie\.espressif\tools\esp32ulp-elf\2.28.51-esp-20191205\esp32ulp-elf-binutils\bin
    C:\Users\danie\.espressif\tools\esp32s2ulp-elf\2.28.51-esp-20191205\esp32s2ulp-elf-binutils\bin
    C:\Users\danie\.espressif\tools\cmake\3.16.4\bin
    C:\Users\danie\.espressif\tools\openocd-esp32\v0.10.0-esp32-20200709\openocd-esp32\bin
    C:\Users\danie\.espressif\tools\ninja\1.10.0\
    C:\Users\danie\.espressif\tools\idf-exe\1.0.1\
    C:\Users\danie\.espressif\tools\ccache\3.7\
    C:\Users\danie\.espressif\tools\dfu-util\0.9\dfu-util-0.9-win64
    C:\Users\danie\.espressif\python_env\idf4.2_py3.8_env\Scripts
    C:\Users\danie\esp32\tools

Checking if Python packages are up to date...
Python requirements from C:\Users\danie\esp32\requirements.txt are satisfied.

Done! You can now compile ESP-IDF projects.
Go to the project directory and run:

  idf.py build


C:\Users\danie\esp32>

Daniel Ashcraft

@dashcraft

Is anyone here using this docker image per chance?
https://hub.docker.com/r/horihiro/moddable-sdk-esp32/tags?page=1&ordering=last_updated

I'm still having issues only with the esp32, i try to avoid docker because it's a resource hog, but this may
create a more stable working environment

Peter Hoddie

@phoddie

I don't know anyone using that image. I recall @mkellner did some exploration with Docker a while back. The Espressif tools are a bit of a pain to set-up and something of a moving target, unfortunately.

Daniel Ashcraft

@dashcraft

Thank you so much for joining @PrototypingAndy_twitter @lprader, I do enjoy moddable sdk and hopefully I can inspire others to use it as well!

Daniel Ashcraft

@dashcraft

Here's the app we're building from the data gathered via these devices, for monitoring.

Andy Carle

@PrototypingAndy_twitter

@dashcraft Thank you for hosting the meetup! Always a delight to hear people talking about their work on our platform. And it's very cool stuff that you're working on; I really think we're on the leading edge of a new "right to repair" boom in consumer/agricultural/industrial/etc. electronics. I'll look forward to hearing more about your company's work as you grow!

Daniel Ashcraft

@dashcraft

ran into another small issue getting my MacBook working for the 32s so while im traveling I can work on embedded stuff.

A fatal error occurred: Failed to connect to ESP32-S2: Timed out waiting for packet header
CMake Error at run_cmd.cmake:14 (message):
  esptool.py failed
Call Stack (most recent call first):
  run_esptool.cmake:21 (include)

I am using a USB dongle if that makes a difference, the device port maps correctly and seems to show the correct USB port though.

Executing "ninja flash"...
ninja failed with exit code 1
make: *** [all] Error 2

This is the same usb chord i used on my pc and it worked fine. That's all I can think of.

Lizzie Prader

@lprader

Yeah, that's not uncommon with ESP32. Try following the instructions here and see if they help: https://github.com/Moddable-OpenSource/moddable/blob/public/documentation/devices/esp32.md#esp32-is-not-in-bootloader-mode

Daniel Ashcraft

@dashcraft

@lprader and of course, that worked like a charm!

Lizzie Prader

@lprader

Great, glad that worked!

STC

@stc1988

Hi, I have a question in relation to documentation for mcbundle.
What is Moddable Store? Is there a application platform to publish moddable apps?

Daniel Ashcraft

@dashcraft

In btutils, there's a maximum advertisement length for uuid's set to 31 characters, i am attempting to bring over a
sandard for ble wifi credential onboarding and their uuid's for characteristics are longer than 31 characters,
https://github.com/improv-wifi/sdk-cpp/blob/main/src/improv.h

Is this hard coded limit part of the underlying gap protocol?

Peter Hoddie

@phoddie

I think it may be. It may also be one of those limits that got increased with a later version of BLE (BLE 5, for example).

Don't have time to go back and review that at the moment. To come at it from another perspective, if the ESP-IDF has a way to sender larger advertisements using thee NimBLE BLE stack, then we can support that in the Moddable SDK. If it doesn't, then we are likely stuck at 31 for ESP32.

Andy Carle

@PrototypingAndy_twitter

Good afternoon, @dashcraft! Could you point me to where you're seeing that 31-character limit in btutils? The limit should be 16 bytes of data, not 31 characters.

BLE UUIDs should all be 128-bit values. The values in improv.h that you linked above look proper to me: 32 hex characters (128 bits) separated by hyphens should be fine.

Daniel Ashcraft

@dashcraft

It's possible i'm using the wrong characteristics payload, completeUUID16List and serviceDataUUID16 is what i'm currently looking at in advertising data params.

Here is the location of the default.

gap.MAX_AD_LENGTH
https://github.com/Moddable-OpenSource/moddable/blob/e9742b49d5132f2723d3a5fca45b65cf3818d01a/modules/network/ble/gap.js#L98
https://github.com/Moddable-OpenSource/moddable/blob/1502614759bbee368833c600222406b1808fb972/modules/network/ble/btutils.js#L441

Andy Carle

@PrototypingAndy_twitter

I believe completeUUID16List is expecting 16-bit UUIDs, as defined in the BLE spec Section 2.5.1. You have 128-bit UUIDs here, so you'll need completeUUID128List/serviceDataUUID128.

How are you working with those functions? In the Moddable SDK, GATT UUIDs are usually processed out of GATT service JSON files, as described in the documentation. A good example of 128-bit UUIDs being used in that way is in the sensortag example. See, for instance, accelerometer.json in that project:

{
    "service": {
        "uuid": "F000AA10-0451-4000-B000-000000000000",
        "characteristics": {
            "data": {
                "uuid": "F000AA11-0451-4000-B000-000000000000",
                "type": "Int8Array"
            },
            "configuration": {
                "uuid": "F000AA12-0451-4000-B000-000000000000",
                "type": "Uint8"
            },
            "period": {
                "uuid": "F000AA13-0451-4000-B000-000000000000",
                "type": "Uint8"
            }
        }
    }
}

Daniel Ashcraft

@dashcraft

I was hard coding them using the uuid function from btutils, this would likely help as well.

I was having issues with the esp32 wroom s2's and memory. Using another service i couldn't run wifi, ble and also load a ssl cert, it would run out of memory.
basically this issue: espressif/arduino-esp32#4523

I was hoping i could find a configuration in moddable to avoid this issue whenever i enabled ble

Peter Hoddie

@phoddie

How is the Arduino issue referenced above relevant here?

Daniel Ashcraft

@dashcraft

It’s not, sorry I was providing context as to why I’m spinning up this improv ble component to begin with.

Peter Hoddie

@phoddie

Not a problem I just read through that report looking for something to learn to apply here and didn't find it.

FWIW - we have deployed commercial projects using ESP32 that use BLE to provision Wi-Fi, communicate with secure MQTT, incorporate a display driven by a Piu-ased UI, provide audio feedback tones -- all without running out of memory. It can be done, but it requires careful attention to memory use.

Michael Kellner

@mkellner

I note that the ESP32-S2 does not support bluetooth.
https://docs.espressif.com/projects/esp-idf/en/latest/esp32/hw-reference/chip-series-comparison.html

Daniel Ashcraft

@dashcraft

@mkellner ahh, i said the wrong thing, ESP-WROOM-32
this is the board i'm using that has a ble component

John M. Wargo

@johnwargo

Sharing this in case anyone's interested; I created a node-based CLI to simplify interaction with the Moddable SDK: https://www.npmjs.com/package/moddable-helper. Hmmm, but the readme isn't displaying.

Peter Hoddie

@phoddie

Hey, @johnwargo, that looks pretty interesting. I will make some time read through the (extensive) docs and give it a try. I'm curious... did you use a particular model for the command line syntax / design or if it is something unique you created for this.

Daniel Ashcraft

@dashcraft

@johnwargo any thoughts around using it for a package manager as well for moddable specific packages? It looks like it does a good job for packages included with the sdk

John M. Wargo

@johnwargo

@phoddie thanks. No, not really, i just hacked away at it until i had something that worked for the way i looked at the process, then tuned it a bit. I have a fair amount of node CLI experience. In this case, i wanted more experience with commander (module)

@dashcraft we can extend it any way we want. Im not sure what you mean, can you give an example?

Daniel Ashcraft

@dashcraft

I’ve created 2 small packages, but there’s no central package management system for moddable compatible packages. Outside of having them included in the core moddable repository of course. But that is limited and bloats the initial get started time a bit.

Daniel Ashcraft

@dashcraft

I need to send a array buffer back to the frontend with the value 0x01
for some reason, this comes back is 44 or 114, sometimes 50

Typedarrays are new to me and I just can't get this to convert correctly

My general setup is like...

const buffer = new ArrayBuffer(16);

const view = new DataView(buffer);
view.setInt8(1, 0x01); 

return view.buffer

Daniel Ashcraft

@dashcraft

i think i figured it out, there's a notifyValue argument for specific types

Peter Hoddie

@phoddie

The code above looks reasonable. FWIW - the first argument to setInt8 is putting the value into the second byte of the buffer, not the first (but that may be intentional).

Daniel Ashcraft

@dashcraft

What was actually happening, was i had set the wrong value in the bleservices json file, and I naively was trying to do what it had already done. I've finally got a working example of implementing improv-wifi (esphomes/hassio's new 'standard' for ble onboarding)

This is going to be a pita to write tests for.
https://github.com/dashcraft/improv-wifi-mod

Peter Hoddie

@phoddie

Understanding what a framework does and doesn't do can sometimes be an adventure. Cool that you got it working. The code like clean and straightforward.

It looks like you created TypeScript declarations for some of the Moddable SDK BLE APIs. Should we think about rolling those into the Moddable SDK for more general use?

John M. Wargo

@johnwargo

@dashcraft so if I understand you correctly, you want have external code, not part of your Moddable 'project' and you want to be able to deploy them as well with mddbl or are you talking about copying the files into your project? I'm assuming the latter since you mentioned package manager. Hmmm, that's a really interesting idea. What I'd really like, in order for me to understand exactly what you mean, is if you'd walk me through the process you invision for this.

8qohse

@8qohse:matrix.org

[m]

He must be talking about something like pip install improv-wifi-mod or npm install express-moddable copying the external files in their project folder; and possibly making the appropriate adjustment in manifest.json?

Where communities thrive

People

Repo info

Activity