Thank you

[mat-l]

Great to see a new project rising to develop an Rhasspy mobile application.
I am really happy with my Rhasspy-Homeassistant setup and your app could be the missing tile in the whole installation.

Looking forward to test your application - sadly I cannot help in the implemenation due to lack of the language.

All the best!

[Nailik]

Hi
thanks for the nice words.

I also use Rhasspy on Homeassistant. I tested https://github.com/razzo04/rhasspy-mobile-app but it didn't support local wake word detection and it should run in background all the time.
First i wanted to fork it but the code is very unstructured so i started with a new project and found out that Android foreground services in Flutter are almost impossible due to the methodchannel and isolate structure.

Therefore i now switched to Kotlin Multiplatform. The Android UI is pretty much finished and Local Wake Word service is also running well.
However MQTT and HTTP service will need quite a while because i have to read all the documentation of rhasspy to mimic the service as good as possible.

I converted this to a discussion because it's probably more useful here.

[Nailik]

MQTT and HTTP service are now integrated for the main part. Not all features are supported.

[mat-l]

I have downloaded the latest version, but I am not yet able to set it up and running with my Homeassistant and Rhasspy. But it can be also due to some local problems with my set up. ✌
From the optical point of view, the app looks already really beautiful.

[Nailik]

Please check the new release if it fixes your issues.

[Nailik]

In the Settings Tab in the app under Log Settings you can enable "Show Log" then you can read the log. This might help you to find your issues.

[Joeviocoe]

@Nailik thank you for picking up this project.
It does appear that the original Rhasspy Mobile App project by razzo04 has been abandoned. That app does work however, but the features I really need won't be included I guess. I tried to compile it with Flutter, but got stuck in dependency hell. When I finally compiled an apk, it would not run.

I can help test your app, but I'm new to Android Studio development and Kotlin.
For your 0.2 release: I am able to get it working somewhat with my HA based Rhasspy instance using MQTT. But it hangs on STT, and TTS seems to cut off the audio too soon (I don't get the full TTS audio).
I compiled the current source code in Android Studio. This app seems more stable (does not hang), but MQTT fails to connect.

org.rhasspy.mobile.android W/NetworkModuleService: null: URI=tcp://org.rhasspy.mobile.observer.MutableObservable@e331e21:org.rhasspy.mobile.observer.MutableObservable@d781246 java.lang.NoSuchFieldException: No field userInfo in class Ljava/net/URI; (declaration of 'java.net.URI' appears in /apex/com.android.art/javalib/core-oj.jar) ...

org.rhasspy.mobile.android E/MqttService: client not connected after attempt
I checked the packets, and it seems the app does not even attempt to connect to my MQTT broker. It is possible I did not build correctly.

[Joeviocoe]

[D] TIME: 2023-01-12T16:30:41.707789 Starting mqtt... TAG: MQTT
[D] TIME: 2023-01-12T16:30:41.710037 Connecting to mqtt... TAG: MQTT
[D] TIME: 2023-01-12T16:30:41.742607 connected TAG: MQTT
[I] TIME: 2023-01-12T16:30:41.743215 Mosquitto client connected TAG: MQTT
[I] TIME: 2023-01-12T16:30:42.673744 Start recording TAG: APP
[D] TIME: 2023-01-12T16:30:42.675512 Send port: SendPort TAG: MQTT
[D] TIME: 2023-01-12T16:30:43.104422 generate new data session TAG: MQTT
[I] TIME: 2023-01-12T16:30:45.340033 Stop recording TAG: APP
[D] TIME: 2023-01-12T16:30:45.469085 received topic: hermes/asr/textCaptured TAG: MQTT
[D] TIME: 2023-01-12T16:30:45.542529 received topic: hermes/nlu/intentParsed TAG: MQTT
[I] TIME: 2023-01-12T16:30:45.543465 Recognized intent: GetTime TAG: DIALOGUE
[D] TIME: 2023-01-12T16:30:45.543771 Waiting for intent to be handle TAG: MQTT
[D] TIME: 2023-01-12T16:30:46.855144 received topic: hermes/audioServer/mobile/playBytes/4f05b473-d50c-4175-b5ff-8ed225eebbad TAG: MQTT
[D] TIME: 2023-01-12T16:30:46.856186 received audio TAG: MQTT
[D] TIME: 2023-01-12T16:30:46.872048 Received audio to play TAG: DIALOGUE
[D] TIME: 2023-01-12T16:30:47.357690 StopRecording request TAG: DIALOGUE
[I] TIME: 2023-01-12T16:30:47.360029 Stop recording TAG: APP

This is the log from the legacy app, that is working.

[Nailik]

@Joeviocoe i think i was able to reproduce your issue and fixed it in 0.4.1 .

[Joeviocoe]

I was able to update through the Play store and the latest version seems your best yet.
Seems to be working stable so far.
Occasionally, it'll get stuck and takes a minute before it will work again.

Still testing. But so far, so good.

[Nailik]

Would be interesting to know when/why it gets stuck.

[Nailik]

@Joeviocoe i just released a pretty big update, should fix a lot of stuck issues.