App Actions Shortcuts - Control Android apps using Google Assistant

In this tutorial, you will learn to Control Android apps using Google Assistant with App Actions Shortcuts. Learn how to extend Android Apps to Google Assistant with App Actions. This tutorial takes you through a complete walkthrough of how you can add your existing android apps to Google Assistant using App Actions. So, in this tutorial, we will learn how to add app actions to your app using built-in intents, navigate to features within the app, search for contents using in-app search.
In this episode, Sachin Kumar, a Google Developer Expert will take you through a complete walk-through on how you can extend your Android application with Google Assistant using App Actions.
App Actions help you expand the reach of your Android app by letting users launch directly into specific app features from Google Assistant. App Actions build on top of your app's deep links, giving users more ways to access the features they already want to use.
▬ Contents of this video ▬▬▬▬▬▬▬▬▬▬
0:00 - Intro
0:30 - What you will learn
0:50 - What are App Actions?
1:19 - Understanding App Actions
1:52 - prepare development environment
2:32 - Import android project
3:22 - Update application id in grade file
4:54 - Generate signed APK
5:12 - Upload to Google Play Console
6:20 - Install Google Assistant App Actions Test tool plugin
7:15 - Add shortcuts and capabilities for GET_THING Built-in Intent
8:12 - Add shortcuts meta-data in manifest
8:52 - Test app using App Actions Test Tool
10:17 - Add OPEN_APP_FEATURE capability in shortcut.xml
11:06 - Final app with app actions shortcuts
11:43 - Outro
In this codelab, you learn how to add App Actions to an app using BIIs (Built-in Intents) from the "Common" BII category, which represents common app tasks that almost any Android app can fulfill. You will learn about App Actions Shortcuts and Capabilities.
What you'll learn
How to use Common category BIIs to extend Assistant to most Android apps.
How to navigate to features within the app with the actions.intent.OPEN_APP_FEATURE BII.
How to connect a built-in intent with an Android activity.
How to get deep link URL parameters for an Android app from the Assistant.
How to use inline inventory to map identifiers to app functionality.
Learn how to test Common BIIs with the Google Assistant plugin for Android Studio.
How to test App Actions in Android Studio.
Built-in-intents
Deep Links
Getting Started with App Actions: Launch and deep link into Android apps from Google Assistant.
By enabling App Actions to extend your app, users can easily deep link into your apps via Assistant by simply speaking a request to the Assistant. App Actions are supported on Android 5 (API level 21) and higher. Integrate Google Assistant in the Android app. Add Voice to your android apps in 2021.
Learn how to Integrate Google Assistant in the Android app. Connect your Android app to Google Assistant.
App Actions connect users from Google Assistant to your Android app.
The GitHub repository for the sample project used in this tutorial is available here.
git clone --branch codelab-start-beta github.com/actions-on-google/...
🔴 Subscribe to the channel to never miss an episode: bitly.com/techwithsach
#GoogleAssistant​ #AppActions​ #AoGProTips #AoGDevs #Android
#Shortcuts

Пікірлер: 47

  • @techwithsach
    @techwithsach2 жыл бұрын

    Let me know how you plan to implement or control features of your app using voice with app actions in your android apps. The video shows you a step-by-step process to get app actions working for your android app. Links to the video are shown in the description. Hope you guys find it useful. More videos to follow. 👍

  • @nikoswee3150
    @nikoswee315010 ай бұрын

    Hi @techwithsach, i am able run app action tools and send the intent to open_app_feature. However when i invoke "open [application_name]" with google assistant voice, it doesnt open up the application. In your video, I see that u voice uttered "show completed task in example application" the application that you installed is named "Todo" why does it launch when it detects example? Have already logged into the developer account that I uploaded to google console play

  • @HTCCrox

    @HTCCrox

    8 ай бұрын

    did you solve it?

  • @ericamankyim5044
    @ericamankyim50442 жыл бұрын

    Hello Mr Sach, I started watching your videos recently and to be sincere with you, I really love them. Especially how you take your time to explain every single stuff. Keep up with the good work.

  • @techwithsach

    @techwithsach

    2 жыл бұрын

    Hi Eric, Thanks for the awesome feedback and so nice of you. Glad you and others found the contents useful and that's the reason I continue with these tutorials. More to follow soon. 🙂

  • @jennirexmolbog9594
    @jennirexmolbog95942 жыл бұрын

    Another great and very helpful video. Thanks a lot

  • @techwithsach

    @techwithsach

    2 жыл бұрын

    Hey Jennirex, glad you found it helpful. Thanks 👍🙂

  • @Neha-wl7zj
    @Neha-wl7zj2 жыл бұрын

    Hello Sir, i was searching for google assistant's architecture on your channel... Is this available somewhere?

  • @erick.aguero
    @erick.aguero Жыл бұрын

    Thank's, excellent tutorial!!

  • @techwithsach

    @techwithsach

    Жыл бұрын

    Thank you. Glad you found it useful. 🙂

  • @rajkiranreddy7134
    @rajkiranreddy71342 жыл бұрын

    Most underrated KZread channel

  • @techwithsach

    @techwithsach

    2 жыл бұрын

    Thank you so much. Hopefully a lot more get to know about it soon. Hope you found the content useful. All the best. 🙂

  • @marnishprabhu7118
    @marnishprabhu7118 Жыл бұрын

    Where is the example application you mentioned ??

  • @purwantojust1637
    @purwantojust16375 ай бұрын

    Hello sir, i finished development app action shortcuts and successfully running. but when release to playstore, all function only running in test account, in other account is not working. what should i do? i finish create ticket in Google Assistant Developer Support but not responding. thanks

  • @ericsmith3639
    @ericsmith3639 Жыл бұрын

    Hi, Thanks for the video. All works great when I set the targetSdkVersion to 32 or lower. But when I set the targetSdkVersion to 33 I get a ActivityNotFoundException. Can anyone else confirm the same issue? Thanks.

  • @oziedza
    @oziedza9 ай бұрын

    Hey Sachin, i am not a developer and trying to learn how to use google assistant commands to control apps, and came across your video. Is there a way to implement google assistant commands on third party apps? Like some in app actions i know dont work with google? Maybe the shortcut.xml file was not updated!

  • @shubhamdiwakar540
    @shubhamdiwakar54010 ай бұрын

    hey sach I have implemented one App published on Internal Testing but when i run app using google Assistance it saying sorry i couldn't found that

  • @atifqamar8986
    @atifqamar8986 Жыл бұрын

    Testing the action with the App Actions Test tool works perfect. But when I try it with my voice interaction like you "Hey Google, show completed in example application", the google search open and not the app.

  • @techwithsach

    @techwithsach

    Жыл бұрын

    Hey Atif, once you push it as a test release in Google play store, you will be able to test it on your physical device. Make sure the Google account is the same. You can follow the steps as shown in the video. All the best. 👍

  • @atifqamar8986

    @atifqamar8986

    Жыл бұрын

    @@techwithsach please help

  • @ericamankyim5044
    @ericamankyim50442 жыл бұрын

    I would be glad if you could make a tutorial on how to build decision tree/button based chatbot using dialogflow or python. Something like TOBi, Vodafone Digital Assistance. Thank you

  • @techwithsach

    @techwithsach

    2 жыл бұрын

    Upcoming tutorials on Dialogflow and Dialogflow CX will cover these. Stay tuned. 👍

  • @sylvaingagnon4189
    @sylvaingagnon4189 Жыл бұрын

    Hello Mr Sach, question, it is possible to control from the display a existing Android apps which don't have any registered actions with Google Assistance by voice?

  • @techwithsach

    @techwithsach

    Жыл бұрын

    Hi Sylvian, didn't understand your query clearly. You can use custom intents with app actions if the built in intents don't satisfy your requirements. Hope this helps

  • @maulikprajapati9816
    @maulikprajapati9816 Жыл бұрын

    Can we use google assistant without app open ?? Using app action with custom intent ?? Same like conversation action or action console work

  • @techwithsach

    @techwithsach

    Жыл бұрын

    Yes you can. You can also use app actions with widgets

  • @SahilSingh-yw9mg
    @SahilSingh-yw9mg Жыл бұрын

    Hey Is it possible to test the dev app without `App Actions test tool`? I mean directly installing the app via Android studio and invoking google assistant.

  • @techwithsach

    @techwithsach

    Жыл бұрын

    Yes, make sure to follow the steps. You should be able to invoke using the Google Assistant on your phone. Make sure both the developer console account and the one that of your Google Assistant are using the same Google account.

  • @SahilSingh-yw9mg

    @SahilSingh-yw9mg

    Жыл бұрын

    @@techwithsach Great Thank you very much, it works correctly!

  • @techwithsach

    @techwithsach

    Жыл бұрын

    Awesome. 🙂

  • @jamesmccarthy3967
    @jamesmccarthy39672 жыл бұрын

    Hey! thanks for the video. Im currently having an issue. When i click "run app action" in the google asssistant test tool, i see the google assistant appear on my device. But then it flashes on the screen "App isn't installed" even though it is. If anyone could help thatd be amazing! thanks

  • @techwithsach

    @techwithsach

    2 жыл бұрын

    Hi James, check the package ID is properly configured. Also, if the app is already installed and as per the video, you can also directly trigger the action directly from your phones Google assistant. Hope this helps.

  • @jamesmccarthy3967

    @jamesmccarthy3967

    2 жыл бұрын

    @@techwithsach thanks for the reply, turns out that because i didn't set the target class, it was giving that error. I feel like they should throw a different, more descriptive error, but oh well. Also was wondering, do you have any good sources to see how to actually handle the intent after it has triggered the app to launch? without using deeplinks. Thanks

  • @alexanderstark6014
    @alexanderstark6014 Жыл бұрын

    Thanks for this great video. Testing the action with the App Actions Test tool works perfect. But when I try it with my voice interaction like you "Hey Google, show completed in example application", the google search open and not the app. What I don't understand, why do you use "example application". The app appears as ToDo app on the dashboard. Any hints? Thanks

  • @atifqamar8986

    @atifqamar8986

    Жыл бұрын

    did you got any solution @alexanderstark6014 ?

  • @djalmajr

    @djalmajr

    9 ай бұрын

    I have the same problem... Any update on this?

  • @djalmajr

    @djalmajr

    9 ай бұрын

    @@atifqamar8986 did you find the answer?

  • @jonathanvargas9693

    @jonathanvargas9693

    9 ай бұрын

    Hello guy I am facing the same issue. Did you were able to solve it?

  • @techwithsach

    @techwithsach

    9 ай бұрын

    I might have updated the app name. Its been a while. Please check the official codelab here which might help you further. codelabs.developers.google.com/codelabs/appactions-2#0

  • @reemaabi
    @reemaabi2 жыл бұрын

    😀👍

  • @AkashMicheal-jl3wp
    @AkashMicheal-jl3wp3 ай бұрын

    will it also work with react native?

  • @AkashMicheal-jl3wp

    @AkashMicheal-jl3wp

    3 ай бұрын

    @techwitchsach please reply

  • @arun_the_pk

    @arun_the_pk

    20 күн бұрын

    I think, it is better to write a Native Android Module in your React native app/project. I used this way in one of my apps.