Page 1 of 2

Mouse control question and feature request

Posted: Wed Jan 18, 2023 1:57 pm
by BrinzerDecalli
Hello,

I have a severe physical disability that keeps progressing. I've found it difficult to fully operate my mouse but can a little and I also have fully loss the ability to use a keyboard. I went to college for digital animation and since my atrophy, I have been unable to do the hotkeys required for animation.

When I found your app, I knew it could enable my creativity, so thanks so much for developing such an empowering tool! I quickly bought the Tobii 5, and it should arrive today.

I was just reading on another post that you are no longer allowing IRIS to do mouse control. Is this true or am I misunderstanding something? This is extremely bad news because I can't move my head. Seems we are getting less eye-mouse software as technology in eye scanning and AI imaging is getting better, and more commercially available, and I don't understand why. Any incites you can offer into this trend?


I also wanted to suggest a feature: Quick Swap Key and Macro
Could you make a trigger [key, interactor, facial gesture] activate the "press key" to assign action of another trigger, so you can use the same trigger [or a few triggers that you can go between] for every key on the keyboard? It'd also be helpful if you can also do the same for bringing up a list of macros [in folders to organize macro types] that you can choose between for that trigger.

Thanks and all the best!

Re: Mouse control question and feature request

Posted: Wed Jan 18, 2023 10:04 pm
by Xcessity
Hello BrinzerDecalli,

thank you for the feedback. Hope you can get back into animation using IRIS.

In terms of mouse control, it is purely about licensing the sdk from tobii. They have a separate assistive product line that is intended for mouse control. The EyeX series is their gaming oriented product line. They don't want that to be mixed up.

You can get the suggested behavior with macros. The macro engine has a very powerful variable and condition system.

Code: Select all

	<MACRO id="SelectActionsA">
		<MAIN repeat="1">
			<VARIABLE id="actionsA" function="SET" value="1"/>
			<VARIABLE id="actionsB" function="SET" value="0"/>
		</MAIN>
	</MACRO>

	<MACRO id="SelectActionsB">
		<MAIN repeat="1">
			<VARIABLE id="actionsA" function="SET" value="0"/>
			<VARIABLE id="actionsB" function="SET" value="1"/>
		</MAIN>
	</MACRO>

	<MACRO id="Action">
		<MAIN repeat="1">
			<CONDITION>
				<VARIABLECONDITION id="actionsA" condition="EQUAL" value="1"/>
				<KEYINPUT behaviour="PRESS" code="0x57"/>
				<KEYINPUT behaviour="RELEASE" code="0x57"/>
			</CONDITION>
			<CONDITION>
				<VARIABLECONDITION id="actionsB" condition="EQUAL" value="1"/>
				<KEYINPUT behaviour="PRESS" code="0x58"/>
				<KEYINPUT behaviour="RELEASE" code="0x58"/>
			</CONDITION>
		</MAIN>
	</MACRO>
Add these macros to your macro file. Create three interactors named: SelectActionsA, SelectActionsB and Action and assign the macros as their triggered action. If you look at the "SelectActionsA" first, the "Action" interactor will press the x key. If you look at the "SelectActionsB" interactor, the "Action" interactor will press the w key.

I know these macros are a little daunting, but maybe you can describe me a specific setup and I will get you started with the macros. Please refer to the macros section of the forum.

Best,
M

Re: Mouse control question and feature request

Posted: Fri Jan 20, 2023 12:17 pm
by BrinzerDecalli
Hey M,
Thanks for your reply!

I got the Tobii 5 and it is acting pretty strangely with IRIS but I am waiting on a USB extension to see if it fixes by being closer to my eyes, cause it is on the distance threshold. In the TobiiX software, it is working fine, and is really accurate, but IRIS seems to think my eyes are looking pretty down right of where they are actually looking. Also, for some reason moving my mouse does not interrupt the eye-tracking control, and even tried setting the right blink to turn on and off the gaze point but the dwell time trigger was not working right and it turned on and off every time it thought I blinked.

I think I understand but isn't that very unethical for Tobii to stop people, who want to develop tools to assist people with disabilities, access to it or contractually limit the function of the resulting tools, only because they want to sell their "medical product" https://us.tobiidynavox.com/products/pceye at a 5x cost premium? It'd be one thing if they invest into it more, giving more advanced hardware and software and that is why it is worth the price, that is one thing, but, no, they changed their policy around SRD access because people can use the Tobii 5 hardware just as well as the EyeX. This choice greatly reduces the potential financial accessibility of both the hardware and future-developed software, not to mention the limits of that software due to restraints.

Do you know of any open-source/developer focused/friendly eye-tracking hardware? Have you considered working with them, since this shackling of your drive to help people become more independent, empowered, and self-actualized, seems so against what you believe in and have worked so hard for?

If you can't talk about this openly in earnest due to contractual obligations, just wink at me. lol

Thanks for the suggestion of code to fix the issue! I didn't realize the macro system it that robust! I'll try it out once I get my USB extension and update you on how it works and any future problems.

Thanks a bunch!

Re: Mouse control question and feature request

Posted: Wed Jan 25, 2023 2:04 pm
by BrinzerDecalli
I got Tobii Experience working almost flawlessly with my Tobii 5 but I am still having issues with IRIS registering where the Tobii experience says I am looking.

Image

See? The circle is the Tobii Experience eye tracker, but up to the left of the interact box, yet the interact box is triggering. Is there a tuning setting that I can't find?

The blinking trigger works correctly again though!

Re: Mouse control question and feature request

Posted: Tue Jan 31, 2023 12:18 am
by Xcessity
Hi,

which monitor resolution is your display using? Are you using any scaling other than 100% (Windows->Settings->System->Display: Scale and layout) ?

Best,
M

Re: Mouse control question and feature request

Posted: Tue Jan 31, 2023 6:48 am
by BrinzerDecalli
Image

Re: Mouse control question and feature request

Posted: Tue Jan 31, 2023 5:29 pm
by Xcessity
Hi,

maybe this is a DPI thing, you can try to change the Compatibility settings for IRIS. Maybe this can fix the issue.

1. Right Click the IRIS App Icon -> select "Properties"
2. Go to the tab that is labeled "Compatibility"
3. Press the "Change high DPI settings" button
4. Try various settings and check if this fixes the problem

Sadly I don't have a high dpi monitor available, I cannot reproduce the problem.
Let me know if any of these options worked.

Best,
M

Re: Mouse control question and feature request

Posted: Wed Feb 01, 2023 5:47 am
by BrinzerDecalli
I actually did try different settings in the compatibility tab before and needed to change it to override high dpi behavior to be able to read the UI.

I just went to try and make sure I tried every setting, but my demo's expired. Could you give me a complimentary code and I promise to buy one if we can get it to work how I need it to!

Do you have any other thoughts? Do you have a way to tweak the calibration points like this one open-source eye-tracking mouse app I found https://youtu.be/aKi3Qr7T764?t=128 ? That won't work because I really need that amazing interactor box system you have developed if I want to use animation hotkeys. But the warping of the calibration grid is next level!

Thanks for the continued help!

Re: Mouse control question and feature request

Posted: Wed Feb 01, 2023 8:16 pm
by Xcessity
Hi,

sure, I'll extend your demo time, send me the device ID that is displayed in the details tab of the license notification window. Send the email to proell@@xcessity.at

Best,
M

Re: Mouse control question and feature request

Posted: Tue Feb 14, 2023 3:07 am
by ican1v5
I just downloaded the software and gave it a try.
The settings seem to be very barebone.
Currently, the reaction and cooldown blocks the view, I tried with transparent picture, but it doesn't work.
I need the app to remind me to look at it and not block it.

See below for a couple of problems to fix before it is usable.

1. Glowing border with effect like this would be best. Or blink. Bar setting is just distracting me during cooldown.
https://www.google.ca/search?q=weakaura ... 4&dpr=1.25

2. Another problem is that the maximum cooldown is too short. I want the max to go up to at least 1 minutes, not sure why there should be any limit anyway.

3. I want to override cooldown when I gaze at it during cooldown. If I just want to keep checking one area every X seconds, then this cooldown would get in the way if I checked before that time. I want the option to reset cooldown timer when I gaze it during cooldown.

4. I want to have timer setup instead of cooldown. For example in a dota game, I want a interactor to remind me(glow) to look at the clock every time at 50 seconds. This would need a hotkey to align start time at the start of the game. And this setting should be changeable, because if start at 0, loading the game might screw it up. I should be able to press X to tell the timer it started at Y seconds. I should have one chance every minute to align it. Ideally, this should draw in-game api to sync, but this might be too much work.

5. If I flick my eye outside of the tracker, the interactor would be locked active until my eyes are being tracked again, maybe some people would want this if you setup pause game upon gaze lost. Please make it an option to start cooldown if eye tracker has lost my eye.

Thanks for doing the work. I will give it another try once it is usable in a moba game, dota 2 specifically for me.