by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Aug 12 16:30
    LexiconCode closed #623
  • Aug 12 16:28
    LexiconCode assigned #825
  • Aug 12 16:28
    LexiconCode labeled #825
  • Aug 12 16:28
    LexiconCode unlabeled #825
  • Aug 10 13:09

    LexiconCode on master

    Updated Dragonfly requirements … (compare)

  • Aug 10 13:04
    LexiconCode commented #824
  • Aug 10 13:04
    LexiconCode commented #824
  • Aug 10 13:02
    LexiconCode commented #824
  • Aug 10 13:02
    LexiconCode closed #824
  • Aug 10 13:02
    LexiconCode commented #824
  • Aug 08 21:28
    mpourmpoulis commented #825
  • Aug 07 11:45
    ileben commented #837
  • Aug 02 01:16
    LexiconCode commented #824
  • Aug 02 01:16
    LexiconCode labeled #824
  • Aug 02 01:16
    LexiconCode unlabeled #824
  • Aug 01 23:53
    LexiconCode closed #183
  • Aug 01 23:53
    LexiconCode commented #183
  • Jul 31 22:20
    LexiconCode commented #831
  • Jul 31 22:00
    LexiconCode commented #837
  • Jul 30 20:50
    LexiconCode commented #838
Matt Wilson
@beyondaxis
I'm used to using my mouse to click around a lot in VS however I'm trying to avoid using my mouse as much as possible and was wondering if you or anyone else has a preferred IDE for this reason. Such as VIM
LexiconCode
@LexiconCode
Yeah I'll let others chime in on that subject has my disability is a little bit different where I do have some use of my hands with mouse movements.
esc123
@esc123
@beyondaxis I to can use the mouse in a limited way but I would say emacs would be an excellent IDE for use with voice if you had no mouse due to it's seemingly unlimited customisability. However there is the cost that comes with this with a steep learning curve and much more leg work required as you have to add the features that are standard for an IDE (eg code completion) yourself that would come straight out of the box with something like VS code
Kitsios Panagiotis
@mpourmpoulis

@beyondaxis while I personally prefer sublime, I agree with @LexiconCode that you should first give it a try with the editor you are already most comfortable with, as trying to adapt to a new editor while also trying to adopt to a voice only style would most likely result in even lower productivity ,until you have customized enough.Either way, if you want things like vim shortcuts there are extensions that should be able to provide you with functionality you need at a good enough level.

now regarding the excessive mouse clicks, do you thing the big contributing factor is

  • Clicking/Interfacing with UI element/buttons perhaps you can find keyboard shortcuts for?

  • Or simply for navigating the source code?

If it is the former, then select-and-say functionality ,to click buttons simply by saying their name,can be your friend. Dragon has its own implementation but there is quite a lot of community work going on at #814 to improve it using accessibility APIs. If that's not enough, then eye-tracking is by far the way to go and there is independent work by @wolfmanstout and @ileben that integrates it with OCR to grab screen text around where you're looking, which should make interfacing with UI elements even easier.

If it is the latter, then your first stop should probably be the excellent TextManipulation commands if it hasn't already. Furthermore quite a few folks in these channel use an Acejump extension for their editor of choice. Finally, you can take a look at any us three projects PythonVoiceCodingPlugin,serenade,VoiceCodeIdea providing syntactical navigation capabilities. Unfortunately, only the second option,which is a whole different stack,supports currently vscode , but by the beginning of the next school year I hope that should no longer be the case

Mark
@MarkRx
If you work from home you can also get a flat trackball mouse and use it with your bare foot :)
LexiconCode
@LexiconCode

do you know how it works with Dragon

I partly miss read this quote. Grammars are compiled and injected ultimately through nalink. So any grammar we create or that in Caster runs alongside any existing commands in DNS. It would be nice if we could directly override DNS commands. There is a grammar in Caster that allows you to customize control over DNS. DNS Quick reference Documentation. If those commands don't work make sure you have the rule enabled by saying enable dragon and that's true of all applications that the need to be enabled at least once.

Matt Wilson
@beyondaxis
Hey thanks for all the help guys
@MarkRx I'm gonna give that a try
Matt Wilson
@beyondaxis
@mpourmpoulis regarding the excessive mouse clicks the contributing factor is both as I currently work in unity doing anything from designing scenes to creating UI as well as coding scripts. I actually just ordered the new Toby I tracker 5 and am hoping I'll be able to find some sort of solution with that and other methods to continue working in unity
tieTYT
@tieTYT
for me the numb command doesn't work correctly if I say "zero" two times. like I can say numb 90066, and it will come out as 906. can anyone else confirm?
log says this: Numbers: numb <wnKK>, 906
LexiconCode
@LexiconCode
I will try to verify.
An interesting topic of voice interfaces came up that is definitely worth a read.
LexiconCode
@LexiconCode

for me the numb command doesn't work correctly if I say "zero" two times. like I can say numb 90066, and it will come out as 906. can anyone else confirm?

Interesting so I'll have to investigate the further. I can't say ninety thousand as it prints out 90 and it is only recognized as ninety. Testing with Dragonfly IntegerRef

Mark
@MarkRx
image.png
When trying to close dragon that error happens all the time. Does anyone else encounter that?
Mark
@MarkRx
Hmm got it to close. I had to close outlook
tieTYT
@tieTYT
90,000
that's what happens when I say 90,000
but if I say numb ninety thousand, I get 90. that's probably what you meant
Dane Finlay
@Danesprite
This only happens with ShortIntegerRef for me.
matrixbot
@matrixbot
LexiconCode Oh sorry about that I'll double check my findings.
Mark
@MarkRx
num doesn't like consecutive numbers for me. If I say "numb 2 8 3 8 7" I get 283 then a bunch of spaces.
tieTYT
@tieTYT
2838
that's what happens if I say it
that's interesting. I'm definitely used numb for longer numbers. I guess there's something flaky about it
LexiconCode
@LexiconCode
it seems numb does not want to exceed 4 whole numbers in one utterance when dictating single digits. For instance one could say 12345 and it only outputs 1234. I won't be able to take a look at this until next Monday as I am actually leaving in a few minutes for a Vacation.
LexiconCode
@LexiconCode
if I had time to test I would verify any issues with the dragonfly grammar. Also I would and experiment with a caster mapping rule. finally I would verify that the integer range is not being truncated/changed wnKK in the merger process.
Dane Finlay
@Danesprite
This seems like a bug with ShortIntegerRef and not a Caster issue. I will have a look into it. Hope you have a nice vacation @LexiconCode :-)
Dane Finlay
@Danesprite
@mrob95 Any idea why this problem with ShortIntegerRef might be happening?
Mike Roberts
@mrob95
Will take a look
Mike Roberts
@mrob95
Looks like the functionality is just not implemented - the original use case was for easily selecting line/page numbers which would usually be in the <10000 range. We can make it adopt IntegerRef's behaviour in the high numbers?
tieTYT
@tieTYT
would this explain why I can't say numb 005?
it comes out as 0
Dane Finlay
@Danesprite

@mrob95 Thanks. Looks like your solution works nicely :+1:

@tieTYT IntegerRef and ShortInteger aren't written for that. It would be a nice addition. One problem with it is that the end result would still be 5 when the words are parsed to an integer.

tieTYT
@tieTYT
well, the reason I would want that feature is so that I could dictate forms that require credit card numbers etc. sometimes those numbers start with multiple zeros. Is it a fair feature request?
Dane Finlay
@Danesprite
Yes, that's fair. There are already Dragonfly element classes for this: Digits and DigitsRef. I don't think they're properly documented at the moment. Try using DigitsRef("d", 1, 12, as_int=False) as an extra. The value you get will be a list of the numbers spoken.
Might be something to add to Caster.
Matt Wilson
@beyondaxis
Is it possible to use other sounds to control commands? Say I wanted to click my tongue to substitute saying "kick"
esc123
@esc123
@beyondaxis Yes but in a very limited way. I’ll copy and paste something I read from another Caster contributor (unfortunately I didn’t record who it was) but im sure they can chime in as well if they see this

"On a random notice, a small update in case anyone is interested in "sounds" with Dragon. after some experimenting, it seems that Dragon can support quiet a few "sounds" without needing to launch accuracy tuning. At the moment I think I have tried around 30 different ones for which we can make dragonfly rules including stuff like shhp,pppf,pppt,tttk,ssss,xxxx. It seems that that the key to get Dragon to recognize those sounds, is to drag the dragonfly specs to them 4 letters or longer. for example, a rule ffp will not work in my end, whereas fffp will!
Unfortunately accuracy can drop if you try to use too many and some combinations do not work well due to phonetic distinctiveness issues. Furthermore, wannabe sounds might be a better description as:

I have no idea how to get things to work with sounds that can not be mapped to letters( so for instance no pops), if anyone has experimented with that and would like to share that would be very interesting!

interestingly, the dragonflies spec will be recognized both if we make a sound or if we spell it. For example , for fffp you can make a sound like here (or adapt a little bit), but it will also recognize if you say FP ( pronounced the same way you would speak fps)

so this is clearly inferior to what dedicated noise recognition systems can do, but I would say it is good enough to get some basic things done. I have been using these lately for things like going up or down, switching between tabs, triggering vimmium , going back and forth in history when browsing or for switching between commonly used applications and so far so good! on my end with DNS 15 home and FlexyMike DEC, unless overloaded Dragon doesn't usually have much of a problem differentiating for instance between shhp,sssp,fffp,tttp,pppp,xxxp,kkkp or fffp,ffft,fffk,fffx,fffs and so on,so you have quite a few options!"

Again this was copied from someone else but can confirm that these noises work as long as 4 letters are used as described
Kitsios Panagiotis
@mpourmpoulis

@esc123 thanks for sharing my old post and giving it a try! It is good to know that others reproduce this:)

@beyondaxis While general-purpose noise recognition with arbitrary sounds does not seem possible with DNS, it does end up ,whether intentionally or by accident, supporting a whole bunch of "letters like" sounds such as fffp,shhh,shhp,pppx,pppt, as long as you pay attention to the four letter trick. of course this is kinda limiting( so you cann't do that tongue click) but it is more than good enough to replace a lot of monosyllables but you might be using for various common tasks like page_up/page_down,next/previous tab,triggering vimium and so on. At the moment, I think I am using about a dozen of such sounds and it is making a world of difference for me,I can highly recommend giving it a try.

For those interested,at #825 there is an example noise grammar for Chrome to get you quickly started

esc123
@esc123
@mpourmpoulis yeah sorry. I copied and pasted it and just forgot where I had read it. I haven't really incorporated any of the sounds into my grammars yet but I will try your chrome script in the next day or two. Using it for Vimmium, page navigation etc. may be a very good use case for this kind of thing. Thanks for sharing it!
Matt Wilson
@beyondaxis
Editing the transformer file words.txt doesn't seem to be working for me I tried to change the directions to their regular counterparts and it seems to take no effect on reboot. Any ideas? All I did was edit that text file as shown in the docs save and then reboot caster.
LexiconCode
@LexiconCode

Editing the transformer file words.txt doesn't seem to be working for me I tried to change the directions to their regular counterparts and it seems to take no effect on reboot. Any ideas? All I did was edit that text file as shown in the docs save and then reboot caster.

Make sure TextReplacerTransformer = false is true found in transformers.toml your user directory in the settings.

Matt Wilson
@beyondaxis
It was true any other ideas?
LexiconCode
@LexiconCode
Do you see Text replacing transformer from file 'words.txt' activated ... when caster starts?