Opened 6 years ago
Closed 6 years ago
#13234 closed Developer Task (Fixed)
Support for Nvidia Shield Remote
| Reported by: | Peter Bennett | Owned by: | Peter Bennett |
|---|---|---|---|
| Priority: | minor | Milestone: | 30.0 |
| Component: | Ports - Android | Version: | Master Head |
| Severity: | medium | Keywords: | |
| Cc: | mtdean@… | Ticket locked: | no |
Description
The NVidia Shield has a very limited remote with only the following buttons:
- Left
- Right
- Up
- Down
- Select
- Back
- Home (not accessible to applications)
Since the Shield is touted as a multimedia device, it should be possible to navigate the application with only the supplied remote.
Attachments (12)
Change History (55)
comment:1 Changed 6 years ago by
comment:2 Changed 6 years ago by
Currently, I think the most limited remote supported by Myth is the Apple Remote. I believe it can do everything except text entry. These have only 6 buttons:
4 arrow keys Play/Pause? Menu
(There are overloaded functions available with a long press of each of the buttons.)
I wonder if the Shield "Select" and "Back" buttons should be mapped the same as the Apple Remote's Play/Pause? and Menu. This means the Shield remote would work with all themes out of the box. Not the most intuitive, perhaps, but no special theming support would be required.
comment:3 Changed 6 years ago by
Please elaborate on how the apple remote is used. There is a wiki page on it which says that it is not much use since it has so few buttons.
https://www.mythtv.org/wiki/Apple_Remote
I wonder how you exit playback without a stop button or a back button, for example.
comment:4 Changed 6 years ago by
Yeah, lhe Apple Remote wiki page has the "Outdate" tag...and really deserves it! There is brief mention on the main Mac page:
https://www.mythtv.org/wiki/MythTV_on_Mac_OS_X#Apple_Remote
I don't know the implementation details, but I think the Apple remote Play/Pause? and Menu buttons are normally passed as the Enter and Esc keystrokes, respectively. The Play/Pause? button will start a recording playing. The Menu button exits playback.
A key difference however, is that a long press on the Apple Remote buttons sends different events. A long press on the Menu button is passed as the M keystroke. Long press on the Play/pause button passes a P keystroke. (It is Mac OS X code that interprets long v. short presses and passes different events; not MythTV code.)
In practise, the only long press I use is the Menu key. Perhaps lacking that differentiation is a killer for the Shield remote, however. Effectively, each of the Apple Remote's 6 buttons send 2 different key codes.
comment:5 Changed 6 years ago by
I tested this on the Shield remote and a long press just generates the same code many times over.
If I fix it so that the Shield can work with its remote that should also enable other limited remotes, so I would prefer not to make it Shield-specific or Android-specific, and preferably not specific to certain themes.
comment:6 Changed 6 years ago by
| Status: | new → accepted |
|---|
I believe I can implement the "long press". I plan to make "long press" of the SELECT button invoke the MENU action.
Details:
- Add a setting for keys (e.g. the SELECT key) that will support "long press". Those keys will NOT support repeat action. To set "long press" on the arrow keys, for example, would be very bad.
- Normally the SELECT button takes effect immediately upon pressing. With this change it will only take effect upon release.
- Use the KeyPress and KeyRelease events to time how long one of those keys is held down and generate a single action upon release. Discard all KeyPress events for that key that are generated in the interim.
- If the button was held down for more than 1 second, generate a MetaModifier on the keystroke to support a long press. The MetaModifier is normally generated when holding the "Windows" key and pressing a button, I am hijacking it for another purpose.
- The normal key mapping feature of !MythTV can assign an action to Meta-Enter or other Meta keys. In particular, I will create a default entry for Meta-Enter to generate the MENU action.
- This is not android specific so it could be used with any remote that uses a KeyPress and KeyRelease event on any operating system.
- I do not know if LIRC would support this, but any remote that connects as a keyboard would support it.
I also plan to add some entries to the menus so that all important actions are available via menu. For example:
- Add "Info" to menus - this will bring up the info menu
- Add "Pause", "fast forward", and "bookmark" to playback menus.
- Possibly add "next menu" to menus so that you can cycle through menus.
comment:7 Changed 6 years ago by
Be nice to use the voice functionality of the shield remote too. That would solve lots of usability issues.
comment:8 Changed 6 years ago by
I believe Kodi 18 supports some integration with Google Assistant on the Shield. Probably mainly search.
comment:9 Changed 6 years ago by
Peter, for Pause, FastForward? and other basic functions during playback, I think an OSD menu like in the Youtube TV interface, VLC, Kodi and others would be more intuitive than the traditonal, MythTV menu that comes up when pressing MENU. The traditional menu could be accessed by choosing the "hamburger" icon in the new menu.
comment:10 Changed 6 years ago by
This is step 1 of the solution.
The attached patch adds support for long presses.
- Long press will work for Shield remote and for keyboards, for selected keys only.
- I added a new section to "edit keys" called "Long Press". You can assign up to 4 keys that will support log presses. Initially only "Enter" is in there.
- I added a default setting for Menu in the global settings, assigned to a long press of Enter. This only takes effect for new frontends. To use it with an existing frontend, use "edit keys" to add a long press of enter to Global Menu.
Next steps
- Solution for bookmarks. The "Enter" key adding a bookmark is IMHO not the best use of the one and only button.
- Solution for an OSD as suggested by David.
- Add missing entries to menus and/or OSD.
comment:11 Changed 6 years ago by
Peter, the long press configuration seems confusing to me. Is there some reason it can't work like the following? When asked to press a key, press a key and release it quickly for a normal (short) press and press and hold for a second before releasing for a long press.
comment:12 Changed 6 years ago by
Here is an update of the patch to allow for up to 16 keys that support long press.
If you previously installed patch 20180312_1140_longpress.patch, please run this SQL after installing the updated patch (20180312_1913_longpress.patch):
DELETE from keybindings where action = 'LONGPRESS';
There will now be 4 actions LONGPRESS1, LONGPRESS2, LONGPRESS3, LONGPRESS4 instead of LONGPRESS.
comment:13 Changed 6 years ago by
This next patch creates a new key mapping for setting and removing bookmarks. It adds Ctrl+K, space and return for setting a bookmark. I would like to remove space and return because I believe that space should pause and return should do something more relevant to most people, like show a menu or a navigation aid. "Enter" is left off since I want to use it for playback navigation on the Shield. Please pass on any comments on what to do about space, Return and Enter.
comment:14 Changed 6 years ago by
Updated longpress patch checks response from TranslateKeyPress and fixes a problem in the previous version.
comment:15 Changed 6 years ago by
Patch to allow bookmarks and a couple of other things to be used with Shield remote. This supersedes the bookmark patch added earlier
- BOOKMARK key mapping defaulting to the existing select keys.
- Program details screen that normally only switches between the two layouts with Info - switch with SELECT action (e.g. ENTER) (as if I was pressed)
- "Set bookmark" and "jump to bookmark" added to Playback navigation menu
- Video list page: switch from the group menu to the file menu (as if Info was pressed) when Menu is pressed again, like Recordings do.
Changed 6 years ago by
| Attachment: | 20180314_1955_menus_and_bookmark.patch added |
|---|
Menu and bookmark changes
comment:17 Changed 6 years ago by
NOTE: I set bookmarks all the time if I'm walking away from a show in progress, just in case.
comment:18 Changed 6 years ago by
I will be changing this a bit as recommended by Micheal Dean (see https://lists.gt.net/mythtv/dev/616275#616275) before committing
comment:19 Changed 6 years ago by
| Cc: | mtdean@… added |
|---|
A new patch for menus and bookmarks. This uses the approach recommended by Michael Dean, see https://lists.gt.net/mythtv/dev/616275#616275.
- Added SETBOOKMARK and TOGGLEBOOKMARK actions in TV Playback context. On a new frontend they are not assigned to any key.
- If an existing frontend gets upgraded to the new version, the keys assigned to SELECT in the Global context will be assigned to either SETBOOKMARK or TOGGLEBOOKMARK depending on whether the "alternate set and remove bookmark" setting was checked.
- The "alternate set and remove bookmark" setting is removed from frontend setup and is no longer used.
- On a new frontend, the space bar will be added as a key on the Pause action. This does not happen on an existing frontend being upgraded.
- Set bookmark, Toggle bookmark and Jump to bookmark are added to the Playback navigation menu.
- The Program details screen that normally only switches between the two layouts with INFO will also switch with SELECT action (e.g. ENTER)
- Video list page: switch from the group menu to the file menu when MENU is pressed a second time. This is similar to what the Recordings list does.
Changed 6 years ago by
| Attachment: | 20180315_1936_menus_and_bookmark.patch added |
|---|
Updated patch, see comment:19
comment:23 Changed 6 years ago by
UI Hidden Focus Bug.
20180904_1233_hidden_focus_bug.patch
Fix bug where if a group containing buttons was hidden, focus tabbing did not work correctly owing to hidden buttons being selected for focus.
comment:24 Changed 6 years ago by
UI Fix Reset button bug.
20180409_1234_reset_button_bug.patch
Reset action on a screen should restore everything to the startup state. Fix the bug that if there are buttons on the screen they would vanish since they were set to invalid state "default" instead of valid state "active".
Changed 6 years ago by
| Attachment: | 20180409_1244_rec_grp_arrows.patch added |
|---|
Playback Support change recording group with arrow keys
comment:25 Changed 6 years ago by
Playback Support change recording group with arrow keys
20180409_1244_rec_grp_arrows.patch
New feature to help with limited remotes such as on the NVidia Shield. On the playback screen, allow the arrow keys to navigate to the recording groups buttons and select a new recording group. This is disabled unless the user selects new option "Change Recording Group using the arrow keys" in setup. This requires some things to be done in themes: (recordings-ui.xml).
- add focusorder 2 to recgroups buttonlist
- add state selectedactive and active to recgroups buttonlist to highlight when the recgroups have focus.
- Remove triggerevent left from groups buttonlist to allow "left" to get to recgroups or set wrapstyle "none" to allow "up" to get to recgroups.
These have been done in the mythcenter and mythcenter wide themes.
comment:26 Changed 6 years ago by
New OSD Navigation screen
20180409_1248_new_osd_nav.patch Note this patch needs the two bug fix patches above to work correctly.
When invoked, OSD Navigation provides a row of icons along the bottom of the playback screen with items like play, pause, jump forward, jump back. There is a "more" button that shows other selections of icons. The navigation icons are displayed in conjunction with the osd_status (progress bar).
There is a new keyboard action available called OSDNAVIGATION. This needs to be assigned to a key in setup under TV Playback. I recommend assigning "Enter", so that the enter button can be used on the NVidia Shield.
There is a default OSD Navigation window included in the default and defaultwide themes, that will show on all themes unless overridden.
Theme designers can create as many buttons as they wish and assign them to as many groups as they wish. They must be set up so as not to overlap with the osd_status display. Actions that are available in TV Playback can be added to buttons as desired by the theme designer. There is no fixed list of actions, they can be decided by the theme designer.
I will document it fully in the wiki for theme designers.
comment:30 Changed 6 years ago by
The 'master' version of Steppes has been updated. I don't have it working on a Shield right now, so if you notice any issues with Steppes, please let me know.
Changed 6 years ago by
| Attachment: | 20180424_1410_osdnav_livetv.patch added |
|---|
Fix some buttons not working with LiveTV
comment:32 Changed 6 years ago by
The play and info buttons are not working in LiveTV. Attached patch 20180424_1410_osdnav_livetv.patch addresses this.
comment:33 Changed 6 years ago by
| Owner: | changed from Peter Bennett to Peter Bennett |
|---|---|
| Status: | accepted → assigned |
Changed 6 years ago by
| Attachment: | 20180425_1504_bkmark_and_pause.patch added |
|---|
Bookmark and pause enhancement
comment:34 Changed 6 years ago by
This patch fixes a couple of anomalies
- Enables bookmarks on LiveTV (both with assigned key (spacebar) and through the OSD Nav).
- The Play/Pause icon will show Play when in FF or REW mode, so that the user can resume play without first having to pause.
This patch is dependent on the prior patch that fixes LiveTV issues.
Changed 6 years ago by
| Attachment: | 20180725_1136_long_press_back.patch added |
|---|
Fix for long press of back button
comment:37 Changed 6 years ago by
Patch 20180725_1136_long_press_back.patch :
Allows long press to be used with back.
Once you assign Back to Long Press, the QT default whereby Back causes a "close" operation will be disabled. Before assigning back to long press, you must assign back to Global Escape and Main Menu exit. Otherwise back will stop working and you will be unable to complete the assignment of long press.
Some back actions may work differently after this, since they will be going through keyboard translation instead of the default QT close action.
Changed 6 years ago by
| Attachment: | 20180725_1646_long_press_back_and_jumppoints.patch added |
|---|
Fix long press back and jumppoints
comment:38 Changed 6 years ago by
Patch20180725_1646_long_press_back_and_jumppoints.patch replaces prior patch
Fixes above issue with long press of Back. Also fixes long press with a jump point, which was not working correctly.
The rules about assigning long press to back button in comment 37 still apply.
comment:43 Changed 6 years ago by
| Resolution: | → Fixed |
|---|---|
| Status: | assigned → closed |
Many of the themes have used the triggerevent tag to map left, right, up and down to various actions. Themes are inconsistent about this. With the Shield limited remote, we will have to be careful how the buttons are used so the the user is not locked out of getting things done.
We can create a shield-specific (android tv specific?) theme or themes or an overlay that gets loaded on top of other themes in the case of the shield or android tv.
I suggest using Select to bring up a menu and right to perform the default action when there is nothing to move to on the right. For example in the recordings screen right will bring you from the groups to the recordings and right on a recording will play. When on a recording, select will bring up the menu. This is the opposite of the recent change in Steppes, but it seems more logical to me. The Select button will universally bring up the menu rather than sometimes the right arrow bringing up the menu and sometimes select bringing it up.
I will work out further details and add them here, as well as a method to make sure users with a limited remote can do everything while traditional users do not find their remotes work differently from before.