mathfly/community

Mike Roberts

@mrob95

Am I right in thinking that natlink can grab the current profile language?

Quintijn Hoogenboom

@quintijn

O yes! I look it up!

Mike Roberts

@mrob95

If so then at least a first implementation would just be to get the current language and redirect to e.g. "lyx_nl.toml"

Quintijn Hoogenboom

@quintijn

import natlinkstatus

language = natlinkstatus.getLanguage()

If would suggest to take nld for dutch as the language is returned so. If it is different from enx use the _nld etc. If it is enx (English) just keep it as it is.

Language in Dragon conventions is always a 3 letter code. In natlinkstatus.py (in the natlink core directory) are they all listed.(line 238)

Thanks Mike, I must quit here for the moment.

Mike Roberts

@mrob95

No worries, I guess you can keep going just adding alternatives for now? Might take me a couple of days to have a look at this

Mike Roberts

@mrob95

mrob95/mathfly#19

Very rough and I haven't done any testing with it, but theoretically at least you should be able to dump some new toml files in config/nld/ which will be imported if the language setting is equal to nld. English will always be used as a fallback

Mike Roberts

@mrob95

Major architectural change. Before updating you will need to run

pip install dfly-breathe

I have entirely replaced the old caster-based CCR backend with Breathe, a library I've been working on. Should make it much easier to add support for new apps etc, and I have fully fleshed out the NestedRule concept which was originally prototyped here. Please let me know if there are any issues.

esc123

@esc123

Cool, Ill give it a test run in the next few days

LexiconCode

@LexiconCode

Were is 'NestedRule' used?

Mike Roberts

@mrob95

Well basically I wanted rules that were like:

Integral from <stuff1> to <stuff2>

Where stuff was a sequence of any other ccr commands. Nested rules were the first implementation based on Caster, breathe allows this by allowing the user to add custom top-level rules. The mathfly examples are in e.g. lyx.py at the bottom but may be slightly difficult to understand at a glance, there are clearer examples on the breathe readme which show greedy dictation and optional repeat values using the same feature.

You just have to define a CommandsRef extra which references a sequence of commands and then include an Exec action to execute the sequence

LexiconCode

@LexiconCode

Awesome I look forward to tinker with mathfly in next few weeks :)

Mike Roberts

@mrob95

Greedy dictation was a feature I really wanted in Breathe, the fact that I could do this as well using the same feature is a nice bonus ;)

esc123

@esc123

started up mathfly again for a new semester after spending the holidays tinkering with caster and I was met with "bad grammar - grammar too complex". The last week or two of the previous semester I was also getting this error and I assumed it was because I edited the toml files and probably did something wrong.

Mike Roberts

@mrob95

Hmmm, are you using the latest (Breathe) version?

esc123

@esc123

however I just installed a fresh version of mathfly with no edits to the toml files and although everything starts up as normal via the nat link window, as soon I execute a command in scientific notebook natlink spits out grammar too complex error

is Breathe the newest version of mathfly?

I had saved version of mathfly that i had used prior to a major update a while back and this version does not suffer from this error

perhaps there is some dependencies that I'm missing. Would there be any way of checking?

Mike Roberts

@mrob95

Ok sorry about that, sounds like I just pushed the limit a bit too far ^^

esc123

@esc123

oh? perhaps it's an issue with my machine in particular

oldish tablet surface pro 4 with eight gigs of RAM. Would that be an issue do you think?

Mike Roberts

@mrob95

I'm not quite sure how the grammar complexity is calculated, I'll look into it at the weekend. I don't think hardware should be a problem

Just to check, try saying "disable LaTeX" to make sure multiple grammars aren't active at the same time

esc123

@esc123

I ran the dependencies.bat script and restarted Dragon. Now the bad grammar error occurs directly after start-up before even initiating a command.

I disabled latex and now attempting to execute commands using scientific notebook mathfly is responding but the bad grammar error is repeated in the natlink window after every command

Mike Roberts

@mrob95

Hmm okay, I haven't actually added any new features so you wouldn't be losing anything by staying on an old version while I fix this

esc123

@esc123

regarding the grammar complexity issue. I remember coming across an article on synkarius blog a while back

that addressed the issues revolving around grammar complexity

yeah that's no problem at all. I'll be switching back to the older version now as its working perfectly

thanks for getting back to me. I know you must be busy going through all that 20 year old natlink python code.

appreciate your work!

Mike Roberts

@mrob95

Haha, for the moment we're stuck at the "Dragon crashes every time I try to load a Python 3 grammar" stage. Love PY3!

esc123

@esc123

lol good times!

Mike Roberts

@mrob95

Okay I can reproduce the issue but don't have much time to debug at the moment. For now I have reverted master to a known good commit, as I say the recent changes didn't really add new features so not a big loss. Thanks for letting me know :-)

btw it would not be difficult to create a scientific notebook grammar for caster rather than having to switch between two grammars, let me know if that would be useful

esc123

@esc123

hmm I never considered that. That would be useful indeed as I have a coding module and a Math/probability module. Switching between them is not overly laborious but not having to do that would be nice :-)

ma-anwar

@ma-anwar

Hi everyone...I'm a new user to mathfly and have found it really useful. Unfortunately it has suddenly stopped working. I use it with Lyx but now when I'm dictating text, dictation only works in math mode. Otherwise, dragon keeps giving me a message saying "please say that again". Dictation works fine across other apps like Word, Chrome, and even in mathmode in Lyx but not outside of math mode. I'd appreciate any help

Mike Roberts

@mrob95

Hi! Glad you're finding it useful. Is it just dictation which is not working? Dragon's dictation can be very picky about which apps it does and doesn't work with, I'm not sure I've got a good solution. You could also try the say <text> command, which should allow you to input text without using Dragon dictation

ma-anwar

@ma-anwar

Say <text> seems to be working fine for now. It's just kind of weird because up until yesterday I was dictating fine in Lyx, in and outside of math mode. So this is kind of weird. But I'll use say text for now. Thanks.

ma-anwar

@ma-anwar

Nevermind...it seems reinstalling dragon and re configuring natlink fixed everything. Thanks!

Mike Roberts

@mrob95

Great, I know a number of people have had the same problem, it seems to just come and go - sometimes Dragon wants to play ball and sometimes not. For most things now I open up a notepad window, dictate into that and then copy across

Anna Kirkpatrick

@annakirkpatrick

@mrob95 Not urgent as it only happens a few times an hour, but I wanted to report an error I'm getting with some of the longer strings of math dictation. In particular, I have latex-maths enabled and I'm getting some warnings in the Python output window. The relevant utterances also are simply not entered into my document. Here are a few examples:

WARNING:engine:Grammar MergeRule(Merged42Ma): failed to decode recognition (u'equals', u'uniform', u'sub', u'one', u'right', u'equals', u'uniform', u'sub', u'two', u'right', u'equals', u'uniform', u'sub', u'three', u'right', u'ampersand', u'equals').

and

WARNING:engine:Grammar MergeRule(Merged15Ma): failed to decode recognition (u'alpha', u'plus', u'x-ray', u'minus', u'one', u'right', u'prekris', u'one', u'minus', u'papa', u'right', u'super', u'script', u'eight', u'up', u'plus', u'november', u'minus', u'x-ray', u'minus', u'one', u'right').

Note that in the first example all of the component words are recognized correctly, while in the second example the word 'bravo' was misrecognized as 'eight up'. I believe even the misrecognition should have yielded a valid sequence of commands, however (if a somewhat silly one).
Like I said, not urgent, but probably a bug worth looking at some point. Let me know if I can provide any more information. Thanks.

Mike Roberts

@mrob95

Hi Anna, firstly I'm impressed that you can hold such a long string of commands in your head at once ^^. I have always needed a pause for thought after a few commands.

I am not 100% sure that this is the issue, but one thing you could try is bumping up the value of max_ccr_repetitions in settings.toml a bit. I don't think there is any science behind the current maximum of 16. Someone chose it a long time ago as a number that was big enough to rarely cause issues while also not triggering grammar complexity errors, and it stuck.

Anna Kirkpatrick

@annakirkpatrick

@mrob95 I think the ability to work with such long strings of commands is just a matter of practice. I dictate a lot of math with a lot of complicated expressions! Also remember that I had been dictating math, with a different system, for about 5 years before I switched to math fly. So, my brain has a lot of practice turning mathematical expressions into spoken words. :-)

Where communities thrive

People

Repo info

Activity