Updates | LipSurf

LipSurf Updates

  1. 2.11.0

    • PREMAdvanced punctuation:
    • Better command matching.
    • Better smart spacing and capitalization.
  2. 2.10.1

    • Fixed initial loading issue.
  3. 2.10.0

    • Improved scrolling.
    • Clicking options in HTML select boxes now works with tag and click *.
  4. 2.9.0

    • Big performance improvements.
    • WaniKani fixes and improvements - including better context switching between lessons and reviews.
  5. 2.8.0

    • Better Outlook.com support.
    • Better Google Sheets support.
    • Stays in modes when changing tabs.
  6. 2.7.2

    • Fixed issue with dictation in Gmail and Google Docs if hosted app is installed.
    • Made scrolling work on Google Docs.
  7. 2.7.1

    • Better tag and click [link text].
    • Dictate * and dictation mode now work for Facebook and Twitter message composition. (Thanks jdevi)!
    • Dictate * and dictation mode now work on Amazon Mechanical Turk (mturk). (Thanks angel)!
  8. 2.7.0

    • New uppercase and lowercase commands will capitalize or uncapitalize your selection.
    • Tag and click [link text] now work within iframes. (That includes Amazon Mechanical Turk (mturk) and many, many other sites!)
    • Improvements to the video commands: eg. play, pause are better at finding the video in the browser now.
    • Lots of new homophones.
    • Custom text-to-speech plugin now available!
      Please email us for access to this plugin.
  9. 2.6.1

    • Fixed issue with smart spacing when replacing existing text selection in Gmail and Google Docs in dictation mode. (Thanks Steve_Peterson)!
  10. 2.6.0

    • Spell with capital letters using capital *, or capital letter * (you can also use full words for better clarity eg. capital boy will write "B").
    • Fixed issue with smart spacing in dictation mode. (Thanks Steve_Peterson!)
  11. 2.5.3

    • Actually fixes upgrade issue.
  12. 2.5.2

    • Fixes upgrade issue.
  13. 2.5.1

    • PREMDictate * and dictation mode now work properly on Evernote (thanks Steve_Peterson!).
    • PREMImproved Google Docs dictation mode
    • PREMBetter recognition of some commands (like undo) in dictation mode.
  14. 2.5.0



    • 🏎️ Performance improvements!

    New Commands

    • Deep Gmail integration is here! 21 new Gmail commands!
    • New select all command!
    • PREMNew spelling by letters with letter *! Try saying eg. "letter b" while on a text input.
    • New Keyboard plugin!
      • Press enter
      • Press tab
      • Press down
      • Press up
      • Press left
      • Press right

    Command Improvements

    • click [elem] improvements.
    • More reliable close help.
    • PLUS"鰐蟹のコンテキストを出て" (exit WaniKani mode) changed to ノーマルモード.
    • "りーぷさーふをきって" (turn off LipSurf) changed to おやすみなさい.
    • Removed click and click # from Reddit plugin to prevent confusion with clicking links by text. Use visit and visit # instead.
    • Removed click # from Hacker News plugin to prevent confusion with clicking links by text. Use visit # instead.
    • Hacker News: you can now visit or upvote the current post.
    • PREMgo to URL doesn't show slash after sites in pretty text.
  15. 2.4.1

    • Fixed issue with LipSurf sometimes not recognizing paid plans.
  16. 2.4.0

    • Less eager pause command.
    • Fixed tag command to update when page moves/changes.
    • Improved click [text].
    • PREMJapanese dictation mode can do new lines with "改行(かいぎょう)".
  17. 2.3.3

    • Improved click [text].
    • Less eager resume command.
    • Minimum version of Chrome is now specified.
    • Now compatible with older versions of Chrome: down to 64.
  18. 2.3.2

    • Fixed plugins not loading.
  19. 2.3.1

    • Fixed plugins not being updated to latest.
  20. 2.3.0

    • New submit command! It's like hitting enter after typing in a form (eg. search boxes).
    • Fixed issue with resetting to factory defaults.
    • Fixed issue where new versions of plugins were not being fetched after 2.0.
    • Fixed over eagerness of stop command.
    • PREMNice text for go to [URL] and accuracy improvements.
    • Fixed Google in Japanese.
    • PREM(BETA) Japanese dictation mode. Added for Japanese:
      • 入力モード(dictation mode)
      • ノーマルモード(normal mode)
      • タブ(tab)
      • スペースキー(space)
      • アンドゥ(undo)
      • リドゥ(redo)
  21. 2.2.0

    • Auto scroll now saves your last selected speed.
    • Fixed scroll commands to work with PDFs
  22. 2.1.1

    • Fixed loading custom plugins.
  23. 2.1.0

    • Import/export custom homophones from the options page.
  24. 2.0.2

    • Fixed custom homophones being erased.
  25. 2.0.1

    • Fixed default plugins not being loaded.
  26. 2.0.0

    • Click by voice (speaking link text)! Just say Click [link text] and the button, link or input field will blink yellow and get clicked. If there is more than one matching link, all the relevant choices are given tags which you can then pick from using the correct tag text.
    • PREMImproved wake-word accuracy.
    • PREMPausing in dictation mode now produces proper spacing.
    • Improved performance and memory footprint.
    • Better default homophones accross the board.
    • Fixed trigger-happy play command.
    • Improved plugin design. Contact us to have your custom plugins updated (or info for developers).
  27. 1.19.0

    • Added copy, cut and paste commands!
    • PREMSay normal mode instead of exit dictation mode to leave dictation mode.
    • PLUSSay normal mode instead of exit wanikani mode to leave wanikani mode.
    • Fixed rare bug that would sometimes cause tags to disappear immediately after showing.
  28. 1.18.0

    • Allow for multi-line custom shortcuts (try clicking the live text to add a custom shortcut).
    • More accurate auto scrolling to posts in Reddit.
    • PREMFixed dictate and dictation mode homophone issue.
  29. 1.17.0

    • PREMAdded undo (BETA) and redo (BETA) support to dictation mode.
    • PREMImproved dictation mode and dictate.
  30. 1.16.1

    • Fixed issue with live text and needs upgrade dialogue where they wouldn't show when LipSurf was restarted on the same page.
  31. 1.16.0

    • Tutorial usability improvements.
    • More Japanese homophones.
    • Options show disabled plugins as faded in the sidebar.
    • Better highlighting of valid commands in the live transcript.
  32. 1.15.3

    • Fixed issue with being occasionally signed out when installed on multiple computers.
    • Improved linking to options.
  33. 1.15.2

    • More Japanese homophones.
    • Keep context help closed if user closes it manually.
    • Fixed issue where sometimes two context windows would show.
    • Fixed issue with live text sometimes not appearing.
    • Improved tutorial scrolling.
    • Reduced size of the application.
  34. 1.15.1

    • Fixed issue with tutorial automatically opening for users that were only updating.
  35. 1.15.0

    • Overhauled tutorial. Make sure to check out the comprehensive new tutorial, you will likely learn something new!
    • Added some Japanese WaniKani commands.
  36. 1.14.3

    • Clearer sign in or register button in options.
    • Fixed tutorial bugs.
  37. 1.14.2

    • Fixed bug when upgrading.
  38. 1.14.1

    • State data added to automatic bug reports.
  39. 1.14.0

    • Performance improvements
    • Better tags (more clickable things)
    • Better dictation mode offers smart capitalization and spacing in more places.
    • Added sleep as an alternative to turn off
    • WaniKani contexts for reviews and lessons, no more worrying about the wrong command being recognized in WaniKani!
    • New Gmail plugin (BETA)
  40. 1.13.3

    • Fixed custom homosyn adder not working on sites like Gmail.
  41. 1.13.2

    • Fixed updates issue.
  42. 1.13.1

    • Fixed wake-word issue.
  43. 1.13.0

    • New pricing!
      • PLUS plan just for WaniKani user's at a reduced price!
      • PREM for all of the features: dictation mode, wake word, go to custom URL -- all in addition to the PLUS features!
      • See pricing page for details.
    • Wake-word changed from "grasshopper" to hey LipSurf.
    • Fixed Gmail scrolling.
  44. 1.12.0

    • Now you can customize per-plugin settings!
      1. Change the default new tab page in the Tabs & Windows plugin!
    • Added speed up and slow down as alternatives for auto-scrolling faster and slower, respectively.
    • Fixed issue with push-to-talk key not turning off on key release.
    • Removed Alt as default push-to-talk key.
    • Fixed issue with dictation mode being hard to exit when on free version.
    • Added more homophones.
  45. 1.11.1

    • Dictation mode improvements (works on Google Docs and more now).
  46. 1.11.0

    • PREMDictation mode for long-form dictation.
    • Introducing contexts!
      • Certain commands are now only possible in a given context (eg. faster/slower commands are only valid if you're in the auto scroll context).
      • Contexts are entered via commands: say auto scroll to enter the auto scroll context, dictation mode to enter the long form dictation context.
      • Commands might be ignored in your context...
        • In the dictation context all the normal commands are ignored and tab, space, new paragraph, new line, and exit dictation are added.
        • In the auto scroll context nothing is ignored, only the faster/slower commands are added.
      • To exit the auto scroll context, say stop or scroll manually. To exit the dictation context say exit dictation.
      • NOTE: switching tabs will also exit a context.
    • Better options page with sidebar for easier navigation.
    • Split up Browser plugin into: Scrolling, TabsAndWindows, Media, Navigation, DictationPREM and LipSurf.
    • Added weather in * as an alternative match pattern for the weather lookup command.
    • Fixed tag and scrolling issues on DuckDuckGo.com.
  47. 1.10.3

    • PREM Made wake-word even less sensitive.
  48. 1.10.2

    • PREM Made wake-word less sensitive.
  49. 1.10.1

    • Fixed issue with uh-oh page sometimes being opened after initial upgrade from v1.9.2
  50. 1.10.0

    • PREM Added wake-word! (It's "grasshopper" for now).
    • Added push-to-talk key!
    • Configurable sound effects for LipSurf activation/deactivation in options.
    • PLUS Added many homophones for WaniKani.
    • Stability enhancements.
  51. 1.9.2

    • Fixed issue with Japanese word splitter.
    • Fixed issues with live-text getting in the way of the page at times.
    • Made it more clear that page that automatically opens after install is the LipSurf tutorial.
  52. 1.9.1

    • Updates to make all WaniKani number items properly recognized.
    • Fixed issues with homophones being expanded to infinity.
    • Don't allow blank custom homophone transcript sources.
  53. 1.9.0

    • Fixed issues with language switching for ja/en.
    • New zoom in, zoom out and reset zoom commands!
    • Fixed some issues with recognizing certain vocab/kanji with numbers in them.
  54. 1.8.2

    • Fixed issues with loading local plugins. Thanks Pat!
    • Infrastructural improvements
  55. 1.8.1

    • Better microphone permission handling and troubleshooting in the tutorial and options.
    • Fixed issue with fonts on Windows and macOS.
    • More 🇷🇺 Russian translations and some fixes general language handling (including 🇯🇵 Japanese). Thank you @ulalasava!
    • Fixed issues on smaller resolutions (eg. help being cut off).
    • Fixed issue with custom shortcuts/homophones and synonyms metrics gathering.
    • Warning in the tutorial for Chromium users about incompatibility. (Install Google Chrome instead).
  56. 1.8.0

    • Custom homophones/synonyms/shortcuts can now be added by clicking the live text!
      • Quickly add a shortcut to do a Google ... query, or activate any other command of your choosing.
      • Map simple words to things that are hard to dictate ...PREM (eg. email addresses, unpronounceable usernames, random sequences of characters, etc.)
      • Correct any misheard transcriptions.
      • Map commands to vocabulary that you have an easier time saying or remembering.
    • New "feeling lucky" command let's you automatically go to the first result of a search query. Try feeling lucky Django documentation.
    • Improved the tag command.
  57. 1.7.1

    • Fixed bug where saying tag would cause high CPU usage.
  58. 1.7.0

    • Completely overhauled the Japanese kanji➡kana conversion (new dictionary download is necessary).
    • Big improvements to the WaniKaniPLUS plugin
    • Loading icon, and language displayed in the icon.
    • Improved language switching speed.
    • Improved subscription modification button
  59. 1.6.9

    • Fixed issue that prevented sign-out and may have caused other authentication issues.
  60. 1.6.8

    • Smarter deprecation logic depends on the user's previous version.
  61. 1.6.7

    • Continuous deployment integration improvements.
  62. 1.6.6

    • Fixed issue where Pro users would get repeat upgrade messages.
    • Chained homophones in WaniKani PLUS fix.
    • Temporary WaniKani PLUS fixes for certain characters.
  63. 1.6.5

    • Hotfix to bug for brand new users in 1.6.4
  64. 1.6.4

    • Testing new release automation.
    • Important updates show as notifications.
    • Better error handling.
  65. 1.6.3

    • Better error handling.
  66. 1.6.2

    • Fixed Japanese number to digit conversion.
  67. 1.6.1

    • Hotfix: LipSurf wouldn't turn on with certain settings configurations.
  68. 1.6.0

    • Added lessons capability for WaniKani PLUS
    • WaniKani PLUS now shows fully correct answer in transcript even when transcript only fuzzy matched answer.
    • Updates now hosted online instead of in-app.
  69. 1.5.0

    • New dictionary command (try saying dictionary "exculpate").
    • New English ⬌ Japanese dictionary commands.
      • Try saying Japanese lookup "jet lag" to lookup an English ➡ Japanese word.
      • Switch to Japanese by saying Japanese then try saying じしょたこやき to lookup "takoyaki" a Japanese ➡ English word.
    • New Wikipedia command (try saying wikipedia "John Perry").
    • Fixed bug with top part of page being un-clickable.

    tip iconTip of the Update

    Remember you can say Japanese or えいご to switch between Japanese and back to English, respectively.

  70. 1.4.0

  71. 1.3.0

    • Better bug/error tracking
  72. 1.2.0

    • Commands in the middle of a transcript are now recognized (see video on the left)!
    • Faster command recognition.
    • New scroll right and scroll left commands.
    • Smarter scroll commands look at viewport height. Thank you @aparajita!
    • Live text stays on top of new tabs and pages.

    tip iconTip of the Update

    Remember you can say options or right click the extension icon and click "options" to see and configure all the possible commands.

  73. 1.1.0

    • New ANKI plugin!
    • Sign-in and registration included in tutorial.
    • Faster play video command.
    • Go to r [subreddit name] is no longer global.
    • Tutorial command.
  74. 1.0.0


    v1.0 and LipSurf Pro are finally here!

    New Commands

    PREM Dictate Text

    Quick text dictation by focusing on an input and saying dictate [text you want to input].

    Great for search boxes, short comments, or messages! You can redo the dictation just by repeating the command.

    PREM Go to URL

    Go to any URL by saying go to [url].

    You can also spell the URL if it's a really hard one. Even the rarer sites are now at your finger ti— err... the tip of your tongue!

    • LipSurf now never starts as activated when Google Chrome opens (even if it was activated when the browser was shutdown last).
    • Old annotate and unannotate command words added as alternatives to tag and untag respectively.
  75. 0.11.2

    • Fixed error collection.
  76. 0.11.1

    • Fixed issues with tutorial.
  77. 0.11

    • New "Anti-Procrastination Plugin"! Try open Reddit for 10 seconds (you can say "open [any website] for [any duration]")
    • Google calendar commands! Try add event to Google calendar or just Google calendar.
    • Changed default shut off time from 20m to 5m.
    • Fixed issue that would occur when many tabs were open (LipSurf wouldn't load).
  78. 0.10

    • Infrastructure improvements.
    • Added BETA Russian support!
    • Added new window command.
    • Added Hacker News plugin.
    • Improved tutorial.

    tip iconTip of the Update

    Now you can say tag and untag instead of annotate/unannotate, respectively.

  79. 0.9

    • Improved annotations.
    • Improved Reddit commands.
    • Performance improvements.
    • New Top Sites plugin. Try saying youtube!
    • Improved Japanese recognition.
    • New WaniKani plugin commands (more info, last 10) and added more homophones.

    tip iconTip of the Update

    We now have a forum where you can make feature requests and ask questions: https://discuss.lipsurf.com

  80. 0.8

  81. 0.7.1

    • Hide updates for 0.7-0.7.1 to not annoy users with too many updates.
  82. 0.7

    • Added more English dialects.
    • Actually fixed issue with overlapping commands in WaniKani specifically.
    • Language picker in first page of tutorial.
  83. 0.6.1

    • Fixed issue with overlapping commands -- delaying commands that are partial matches of other commands.
    • Fixed issue with command priority.

    tip iconTip of the Update

    Try using a headset for improved transcript accuracy. Apple headphones work quite well! If you see 3 rings on your headphone jack (like in the picture), that means there's a microphone.

  84. 0.6

    • Fixed issue where live text would show but commands would not be executed.
    • Fixed issue where LipSurf would break after any network issue -- sometimes caused by saying many things while LipSurf is activated.
    • Fixed issue with setting auto. off timer to 0 not working.
    • Added English homophones: kay ➡ k, okay ➡ ok, are ➡ r, you ➡ u
    • Fixed issue where toggling LipSurf on WaniKani would sometimes cause the wrong language to be selected.
    • Fixed issue where LipSurf would stay on if it was shutdown while on a Japanese reading for WaniKani.
    • Fixed issue with recognizing WaniKani vocab/kanji with numbers.
    • Added many default homophones for WaniKani. esp. for Romaji ➡ Japanese.
    • Fixed issue with apostrophes, hyphens in WaniKani answers.

    tip iconTip of the Update

    Don't say "annotations off" say "turn off annotations" or "hide annotations" -- that way LipSurf doesn't jump the gun and think you're saying just "annotate".

  85. 0.5

    • You can now spell out hard-for-the-recognizer words in WaniKani.
      1. If already in English mode (answering meanings) then just start spelling it out.
      2. If in Japanese mode, first say "えいご" then spell the reading as you would type it
        (eg. for しょうがつ say "s-h-o-u-g-a-t-s-u")
    • Added commands to switch between Japanese and English.
    • Fixed bugs with general Japanese and WaniKani.

    tip iconTip of the Update

    You can spell out words if LipSurf is having trouble recognizing you.

    Try spelling out "g-o-o-g-l-e-l-i-p-s-u-r-f".