icebreaker-fpga/Lobby

Discuss the iCEBreaker FPGA dev board by 1 Bit Squared

Sid Price

@sidprice

  File ".\fmt-gitter", line 200, in <module>
    main()
  File ".\fmt-gitter", line 193, in main
    data = json.loads(text)
  File "C:\Python37\lib\json\__init__.py", line 348, in loads
    return _default_decoder.decode(s)
  File "C:\Python37\lib\json\decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "C:\Python37\lib\json\decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Am I missing a python library?

Bob Miller

@kbob

@sidprice Probably python 3.x.

Look at the json file. Sometimes there is an extra comma at the last or next-to-last line.

Sid Price

@sidprice

@kbob , yes there was an extra comma, but I still get the same error

Bob Miller

@kbob

Hmmm. I am going to run it myself from here.

Sid Price

@sidprice

This json is really badly formed, if I understand how it is supposed to look

Bob Miller

@kbob

It’s for machines to read, not for us.

Sid Price

@sidprice

I searched the json and didn't find the thing I was looking for, this may be a fruitless exercise

Bob Miller

@kbob

Is it this room, icebreaker-fpga/Lobby?

Sid Price

@sidprice

Yes

Piotr Esden-Tempski

@esden

@kbob is your tool essentially downloading the archive? https://gitter.im/icebreaker-fpga/Lobby/archives/all

Bob Miller

@kbob

It is using Gitter’s API to download the same information, yes.

Sid Price

@sidprice

I used the tool you linked to after getting the API key as you described

Bob Miller

@kbob

I am getting errors downloading the JSON. Still working on it — I slowed it down.

Sid Price

@sidprice

The download ran fine for me

Bob Miller

@kbob

I got errors about too many requests. gitter-export-room has rate limiting, but it is random (why?). So either gitter org has lowered the rate limit or I’ve had unlucky random numbers.

So I made a one line change and am trying again.

fmt-gitter worked for me. sigh...

Sid Price

@sidprice

smacks-forehead

Bob Miller

@kbob

gitter-scraping-instructions$ python --version
Python 3.7.4

Python 3.6 fails, though.

Sid Price

@sidprice

PS C:\Data_Root\Projects\gitter-scraping-instructions> python.exe --version
Python 3.7.4

Bob Miller

@kbob

  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/_strptime.py", line 362, in _strptime
    (data_string, format))
ValueError: time data '2018-02-07T04:49:36.743Z' does not match format '%Y-%m-%dT%H:%M:%S.%f%z'

Does that look like your error?

Sid Price

@sidprice

No, it is pasted above

Bob Miller

@kbob

You pasted yours above.

Yours says the error is at line 1 column 1. Does the beginning of the JSON file look OK?

Mine looks like this.

gitter-scraping-instructions$ head some-file.json
[
{
  "id": "5d5c14e20eff7d2dfee66c32",
  "text": "yeah that is it",
  "html": "yeah that is it",
  "sent": "2019-08-20T15:42:26.895Z",
  "fromUser": {
    "id": "5395250aa9176b500d1cd734",
    "username": "esden",
    "displayName": "Piotr Esden-Tempski",

Sid Price

@sidprice

[
{
  "id": "5d5bbc489507182477148b48",
  "text": "Hey @esden, how did you get sled running on the cube? out_mpsse_spi on a Pi? Did you have to do any changes? Someone is trying to run my matrix on a Pi 4 and having weird issues with it, all related to libmpsse, it seems.",
  "html": "Hey <span data-link-type=\"mention\" data-screen-name=\"esden\" class=\"mention\">@esden</span>, how did you get sled running on the cube? out_mpsse_spi on a Pi? Did you have to do any changes? Someone is trying to run my matrix on a Pi 4 and having weird issues with it, all related to libmpsse, it seems.",
  "sent": "2019-08-20T09:24:24.108Z",
  "fromUser": {
    "id": "58368374d73408ce4f3845e6",
    "username": "vifino",
    "displayName": "Adrian Pistol",
    "url": "/vifino",
    "avatarUrl": "https://avatars-02.gitter.im/gh/uv/4/vifino",
    "avatarUrlSmall": "https://avatars1.githubusercontent.com/u/5837359?v=4&s=60",
    "avatarUrlMedium": "https://avatars1.githubusercontent.com/u/5837359?v=4&s=128",
    "v": 27,
    "gv": "4"
  },
  "unread": false,

Encoding issue? I am running Windows 10

Bob Miller

@kbob

Dunno. Maybe. I think it assumes UTF-8.

Sid Price

@sidprice

Lemme play with encoding

Bob Miller

@kbob

Okay.

Since I have the complete HTML file, would you like me to search for something for you? I can give you a permalink to the right part of the conversation...

And you can view it on gitter.im web site.

Sid Price

@sidprice

I was looking for Harbor Freight

Temperature probes

Bob Miller

@kbob

https://gitter.im/icebreaker-fpga/Lobby?at=5d5c30552cdb146ad60a7789

Oops that’s today.

https://gitter.im/icebreaker-fpga/Lobby?at=5c13b32a987052387ee53e41

No mention of Harbor Freight other than you asking today.

Bob Miller

@kbob

@sidprice I don’t see anything. I searched for temperature, probe, harbor, and misspellings, and came up empty except for the links above.

Sid Price

@sidprice

Shoot, I guess my memory has failed me.

Sid Price

@sidprice

@kbob , thanks for all the effort here, there must have been a discussion on another channel, maybe blackmagic. I will dig into the file format and maybe try looking there.

@kbob the file needs to be ANSI encoded

Bob Miller

@kbob

What is ANSI encoding?

Bob Miller

@kbob

This is ANSI encoding.

I believe Gitter uses UTF-8. So gitter-export-room should produce UTF-8.

But thanks for the info.

Sid Price

@sidprice

On windows the original file is UCS-2 LE BOM, I have no idea what that is. I converted it to ANSI and the converter worked.

Where communities thrive

People

Repo info

Activity