WEBVTT 00:00:00.000 --> 00:00:02.740 Today we're building a copilot agent using computer 00:00:02.740 --> 00:00:06.280 use within Microsoft Copilot Studio. This is 00:00:06.280 --> 00:00:08.939 one of the newest tools available and using natural 00:00:08.939 --> 00:00:12.199 language you tell this tool what to do and it 00:00:12.199 --> 00:00:14.580 drives a virtual mouse and keyboard and gets 00:00:14.580 --> 00:00:17.379 the task done for you. You have to see it to 00:00:17.379 --> 00:00:19.960 believe it. We'll be building this agent step 00:00:19.960 --> 00:00:23.210 by step so that you can follow along. My name 00:00:23.210 --> 00:00:25.269 is Shervin Shafi and I'm a Co -Pilot Principal 00:00:25.269 --> 00:00:28.710 Engineer at Microsoft. Welcome to Collaboration 00:00:28.710 --> 00:00:42.770 Simplified. Okay, so let's jump straight into 00:00:42.770 --> 00:00:45.329 building this agent. We're inside Copilot Studio 00:00:45.329 --> 00:00:47.950 and we're looking at an agent that I actually 00:00:47.950 --> 00:00:50.530 built in the past. It was called the HR Miracle 00:00:50.530 --> 00:00:53.210 Worker Pro. And if you want to know how it was 00:00:53.210 --> 00:00:56.009 built, it was basically in one of my videos in 00:00:56.009 --> 00:00:58.990 the past in this Copilot Agents one right over 00:00:58.990 --> 00:01:01.030 here. So if you want to see how that was built, 00:01:01.189 --> 00:01:03.549 it was demonstrated in this video. But the reason 00:01:03.549 --> 00:01:05.950 why I'm showing it to you is because I'm going 00:01:05.950 --> 00:01:09.079 to rebuild it this time using computer use. So 00:01:09.079 --> 00:01:11.120 the reason I'm rebuilding it is because this 00:01:11.120 --> 00:01:14.640 particular agent, HR Miracle Worker Pro, it basically 00:01:14.640 --> 00:01:18.719 connects to ServiceNow and it does it using connectors 00:01:18.719 --> 00:01:21.340 or API. So you can see under the tool section 00:01:21.340 --> 00:01:23.859 here, there's this tool called List Records. 00:01:24.099 --> 00:01:26.859 So if I open it up, you can see that basically 00:01:26.859 --> 00:01:30.000 it connects to ServiceNow. There's even more 00:01:30.000 --> 00:01:32.299 to it than that. This is actually the easy part. 00:01:32.400 --> 00:01:35.599 But on the top here, if I click this plus five, 00:01:36.250 --> 00:01:38.989 I can go to a section called Topics. And when 00:01:38.989 --> 00:01:42.950 I go into Topics, there's a section here called 00:01:42.950 --> 00:01:45.969 Booking Vacation that I created. And when I open 00:01:45.969 --> 00:01:48.670 that up, there's a flow in here that says, look, 00:01:48.769 --> 00:01:52.269 if somebody is asking you to book a vacation, 00:01:52.469 --> 00:01:55.370 this is a trigger. Ask them these questions and 00:01:55.370 --> 00:01:59.530 ultimately it goes ahead and it connects to this 00:01:59.530 --> 00:02:02.810 custom connector. And again, the reason I'm showing 00:02:02.810 --> 00:02:05.090 you all this is to kind of show you all the work 00:02:05.090 --> 00:02:08.909 that has to go into play to create a connection 00:02:08.909 --> 00:02:11.770 to ServiceNow. So this particular connector, 00:02:12.069 --> 00:02:15.550 if we go to the designer section of it inside 00:02:15.550 --> 00:02:18.889 of Flow, not only does it list the record over 00:02:18.889 --> 00:02:21.909 here, there's some work involved there, but for 00:02:21.909 --> 00:02:24.889 each transaction, it also updates the record. 00:02:25.090 --> 00:02:27.189 And when we look at updating the record here, 00:02:27.960 --> 00:02:30.319 it looks at hours that were booked someone's 00:02:30.319 --> 00:02:32.219 trying to book vacation we want to see how many 00:02:32.219 --> 00:02:34.180 hours they had booked and hours they have left 00:02:34.180 --> 00:02:37.000 and there's formulas in there we want to bypass 00:02:37.000 --> 00:02:39.620 all this right we don't want to have to do all 00:02:39.620 --> 00:02:42.219 this work we just want to tell this computer 00:02:42.219 --> 00:02:44.659 use agent click here click there and just do 00:02:44.659 --> 00:02:47.900 it without having to do a little bit of low code 00:02:47.900 --> 00:02:56.099 if you will now what do we want in terms of steps 00:02:56.759 --> 00:02:59.860 this computer use to do. So this is what we wanted 00:02:59.860 --> 00:03:04.800 to do. I have a ServiceNow developer login. And 00:03:04.800 --> 00:03:07.740 so what I want this computer use to do is, first, 00:03:07.879 --> 00:03:11.800 I wanted to go to this website, developer .servicenow 00:03:11.800 --> 00:03:15.159 .com. Then I wanted to click on sign in, then 00:03:15.159 --> 00:03:18.819 I wanted to sign in with my login of I love computer 00:03:18.819 --> 00:03:23.500 use at outlook .com. And then put in my password 00:03:23.500 --> 00:03:28.319 of copilot studio rocks and then click sign in 00:03:28.319 --> 00:03:32.719 and then once it signs in i wanted to go to this 00:03:32.719 --> 00:03:36.340 section here under app engine studio i wanted 00:03:36.340 --> 00:03:39.719 to select that and then once it selects that 00:03:39.719 --> 00:03:42.599 i wanted to scroll down to this my app section 00:03:42.599 --> 00:03:46.740 and click on hr and once it does that i wanted 00:03:46.740 --> 00:03:49.479 to close that out and then go here and click 00:03:49.479 --> 00:03:56.150 on this hrdb this hr database and then once that's 00:03:56.150 --> 00:03:59.509 done i want it to go over here on the top and 00:03:59.509 --> 00:04:04.449 i wanted to select preview and then it gets this 00:04:04.449 --> 00:04:08.490 table of my employees and basically i have four 00:04:08.490 --> 00:04:12.889 employees i have jane pete sammy and bob and 00:04:12.889 --> 00:04:14.909 then i can see how many hours they've booked 00:04:14.909 --> 00:04:16.990 and how many hours they have left and then i 00:04:16.990 --> 00:04:20.850 wanted to update these hours by what is being 00:04:20.850 --> 00:04:23.449 requested of it that other agent miracle worker 00:04:23.449 --> 00:04:27.069 pro did all that using connectors or apis but 00:04:27.069 --> 00:04:29.610 i want computer use to do it by just clicking 00:04:29.610 --> 00:04:32.410 and using the keyboard and mouse and getting 00:04:32.410 --> 00:04:35.129 to it and updating these fields because ultimately 00:04:35.129 --> 00:04:38.569 if i wanted to update jane's profile i wanted 00:04:38.569 --> 00:04:41.329 to click on jane i wanted to go to these numbers 00:04:41.329 --> 00:04:44.129 and update them and then click update all right 00:04:44.129 --> 00:04:46.569 so that's the use case this is what we're going 00:04:46.569 --> 00:04:53.329 to build together To build it, we start off in 00:04:53.329 --> 00:04:56.490 Copilot Studio and on the top left -hand side, 00:04:56.769 --> 00:05:00.389 I'm gonna select create and I'm gonna select 00:05:00.389 --> 00:05:03.449 new agent and I'm just gonna select create on 00:05:03.449 --> 00:05:07.490 the top right -hand side to get the template 00:05:07.490 --> 00:05:09.449 of the agent created. So we'll just give it a 00:05:09.449 --> 00:05:13.029 sec here. Now I can go ahead and select edit 00:05:13.029 --> 00:05:16.730 over here to edit the agent name and we're gonna 00:05:16.730 --> 00:05:23.310 call it computer use. for service now and i'm 00:05:23.310 --> 00:05:25.949 going to click on change the icon over here and 00:05:25.949 --> 00:05:30.230 then again here change icon i have clippy so 00:05:30.230 --> 00:05:33.670 let's use this one let's go ahead and click edit 00:05:33.670 --> 00:05:36.329 again and give it a description for the agent 00:05:36.329 --> 00:05:42.709 an agent that can book vacation days for employees 00:05:42.709 --> 00:05:46.129 okay and then we're going to click save on the 00:05:46.129 --> 00:05:50.180 top right hand side here so we got the name We 00:05:50.180 --> 00:05:52.519 gave it a picture. We gave it the description. 00:05:53.180 --> 00:05:56.759 And it's using the GPT -4 -0 model. And by the 00:05:56.759 --> 00:05:59.759 way, if you were curious, if you select settings 00:05:59.759 --> 00:06:03.500 for the agent, you might be able to, in your 00:06:03.500 --> 00:06:05.939 version, change the models to different ones, 00:06:06.019 --> 00:06:09.740 like 4 -1, GPT -5 auto, GPT -5 reasoning, and 00:06:09.740 --> 00:06:11.600 so on. So I'm going to stick with the default 00:06:11.600 --> 00:06:14.019 at the moment, but just kind of a heads up. And 00:06:14.019 --> 00:06:15.660 there's some other things you can change here, 00:06:15.699 --> 00:06:19.269 like content moderation. Right now it's set to 00:06:19.269 --> 00:06:21.870 high. Maybe you want to set it to low just to 00:06:21.870 --> 00:06:23.569 kind of experiment. So there's all these kinds 00:06:23.569 --> 00:06:27.709 of things you can check. And also here, sometimes 00:06:27.709 --> 00:06:31.110 people are like, well, it's using the knowledge 00:06:31.110 --> 00:06:33.790 of the large language models. And then you can 00:06:33.790 --> 00:06:35.850 actually turn it off so that general knowledge 00:06:35.850 --> 00:06:37.629 isn't used. But we're going to leave it on for 00:06:37.629 --> 00:06:40.290 now. So there's some cool settings kind of as 00:06:40.290 --> 00:06:43.500 a pro tip if you want to click. on the top right 00:06:43.500 --> 00:06:45.560 hand side you get to all those sections okay 00:06:45.560 --> 00:06:48.040 now what are we going to do in terms of instructions 00:06:48.040 --> 00:06:52.879 well i needed to kind of flow where it asks a 00:06:52.879 --> 00:06:55.360 bunch of questions like who are you booking this 00:06:55.360 --> 00:06:58.680 vacation for and then i wanted to get to the 00:06:58.680 --> 00:07:01.600 computer use so first what we're going to do 00:07:01.600 --> 00:07:05.300 is we're going to go to this plus 5 over here 00:07:05.300 --> 00:07:09.730 and we're going to create a topic And here I 00:07:09.730 --> 00:07:11.930 selected this arrow next to it and I'm going 00:07:11.930 --> 00:07:14.810 to add from a description with Copilot. So here 00:07:14.810 --> 00:07:20.069 I'm going to call it booking vacation. And I'm 00:07:20.069 --> 00:07:21.910 going to create a topic. I'm going to tell it 00:07:21.910 --> 00:07:27.029 what I wanted to do. So get the first and last 00:07:27.029 --> 00:07:32.850 name of the person looking to book vacation. 00:07:33.740 --> 00:07:38.699 as well as how many hours they want to book all 00:07:38.699 --> 00:07:41.720 right let's go ahead and create that see what 00:07:41.720 --> 00:07:45.139 it does close this out close out this side here 00:07:45.139 --> 00:07:48.540 and so basically it says this tool handles queries 00:07:48.540 --> 00:07:52.319 like book a vacation plan my holiday and then 00:07:52.319 --> 00:07:54.860 the first question this is all auto generated 00:07:54.860 --> 00:07:57.480 based on what i just wrote it what is your first 00:07:57.480 --> 00:08:01.019 and last name and it says identify the person 00:08:01.560 --> 00:08:05.600 as their first and last name over here and what 00:08:05.600 --> 00:08:08.279 i want to do is i just actually select it on 00:08:08.279 --> 00:08:11.439 the person's name just select it and then i want 00:08:11.439 --> 00:08:14.540 to do multiple choice options so i just want 00:08:14.540 --> 00:08:17.379 to give it that information so i'm going to select 00:08:17.379 --> 00:08:20.579 multiple choice and it says option for the user 00:08:20.579 --> 00:08:24.779 if i actually go to my database for service now 00:08:24.779 --> 00:08:27.439 these are the names of the people that i had 00:08:27.930 --> 00:08:31.029 Jane Ingley, Pete PD. Let's put those people 00:08:31.029 --> 00:08:35.049 in. So go back here and for the first option, 00:08:35.169 --> 00:08:40.309 we're going to put Jane Ingley. And then click 00:08:40.309 --> 00:08:45.409 enter. Plus new option, Pete PD. Don't tell me 00:08:45.409 --> 00:08:48.889 how I came up with these names. Click new option, 00:08:49.149 --> 00:08:56.700 Sammy Belong. I'm going to put Bob Smith. All 00:08:56.700 --> 00:08:58.840 right, so hopefully those are all the right names. 00:08:58.940 --> 00:09:00.960 So we're asking for the first and last name. 00:09:01.000 --> 00:09:05.419 We're giving options. And then this all got auto 00:09:05.419 --> 00:09:09.360 -created. So based on what it equals, like all 00:09:09.360 --> 00:09:11.759 of these feed into the next questions. How many 00:09:11.759 --> 00:09:14.559 hours do you want to book? It's a number and 00:09:14.559 --> 00:09:17.919 the response is saved as hours. The other response 00:09:17.919 --> 00:09:21.750 was saved as name. And so I think this is good 00:09:21.750 --> 00:09:23.250 for now, right? So I'm just going to go ahead 00:09:23.250 --> 00:09:25.389 and on the top right hand side, I'm just going 00:09:25.389 --> 00:09:28.090 to click save. So this is a topic. What we're 00:09:28.090 --> 00:09:31.269 going to do next is eventually we're going to 00:09:31.269 --> 00:09:33.809 pull all this together in the instructions. But 00:09:33.809 --> 00:09:36.649 at the moment that I've clicked save, I'm going 00:09:36.649 --> 00:09:39.429 to click on overview on the top here. And I'm 00:09:39.429 --> 00:09:42.970 going to scroll down to the tool section so we 00:09:42.970 --> 00:09:46.269 can use, we can add our computer use. So I go, 00:09:46.309 --> 00:09:48.929 I'm going to go ahead and select add a tool. 00:09:49.959 --> 00:09:53.059 And this is where you would generally search 00:09:53.059 --> 00:09:55.539 for all these connectors, right? So if I searched 00:09:55.539 --> 00:09:58.299 for ServiceNow, those different ServiceNow connectors 00:09:58.299 --> 00:10:00.919 that we used in the other agent, they all pop 00:10:00.919 --> 00:10:02.919 up here, but we're not going to do that. What 00:10:02.919 --> 00:10:05.200 we're going to do instead is I'm going to go 00:10:05.200 --> 00:10:09.940 ahead and select plus new tool over here. And 00:10:09.940 --> 00:10:13.580 then this is where all those tools show up, including 00:10:13.580 --> 00:10:18.000 computer use. in the past we actually did a video 00:10:18.000 --> 00:10:21.059 on the model context protocol that's actually 00:10:21.059 --> 00:10:24.559 a cool one where we connected to DocuSign and 00:10:24.559 --> 00:10:27.039 then today we're going to do computer use which 00:10:27.039 --> 00:10:29.259 again you can see it's in preview at the moment 00:10:29.259 --> 00:10:33.399 and by the way real quick we have some really 00:10:33.399 --> 00:10:35.960 good documentation on computer use so if you 00:10:35.960 --> 00:10:39.620 go to the Copilot Studio admin guide this is 00:10:39.620 --> 00:10:43.240 the documentation for computer use right here 00:10:43.240 --> 00:10:46.559 and it was posted maybe about a month ago and 00:10:46.559 --> 00:10:49.000 so definitely check that out there's a good video 00:10:49.000 --> 00:10:51.240 in here it talks about how to add it to your 00:10:51.240 --> 00:10:53.820 agent which we're doing at the moment all kinds 00:10:53.820 --> 00:10:57.779 of good stuff in this documentation now back 00:10:57.779 --> 00:11:01.059 to the agent we'll just select computer use and 00:11:01.059 --> 00:11:05.080 here it says look what are the instructions that 00:11:05.080 --> 00:11:08.519 you want to put in for the computer use for example 00:11:08.519 --> 00:11:11.960 go to this website add an invoice all this kind 00:11:11.960 --> 00:11:16.179 of stuff or do you want to start with a template 00:11:16.179 --> 00:11:19.580 you know for invoice processing or for data entry 00:11:19.580 --> 00:11:22.679 and if you select invoice processing or data 00:11:22.679 --> 00:11:26.500 entry or data extraction it actually puts a sample 00:11:27.340 --> 00:11:30.860 set of instructions in here and these websites 00:11:30.860 --> 00:11:34.419 are actually live so this is a good way for you 00:11:34.419 --> 00:11:37.639 to experiment if you don't have a place to experiment 00:11:37.639 --> 00:11:40.580 with so definitely check this out and these are 00:11:40.580 --> 00:11:42.940 also in the video and in that link as well in 00:11:42.940 --> 00:11:45.899 the documentation now for now i'm just going 00:11:45.899 --> 00:11:48.019 to go ahead and erase all this i'm not going 00:11:48.019 --> 00:11:51.669 to put any instructions the other thing to note 00:11:51.669 --> 00:11:55.730 is that it says look how are you connecting to 00:11:55.730 --> 00:11:57.649 this computer that's running these instructions 00:11:57.649 --> 00:12:02.470 and i'm using a hosted browser which if you look 00:12:02.470 --> 00:12:05.230 for what it is if you click the i and go to learn 00:12:05.230 --> 00:12:08.230 more it opens up that site that i showed you 00:12:08.230 --> 00:12:11.669 and if you scroll all the way down to a section 00:12:11.669 --> 00:12:15.990 in the bottom here it says configure where your 00:12:16.409 --> 00:12:19.250 computer use runs. So I'm gonna be using this 00:12:19.250 --> 00:12:23.149 hosted browser powered by Windows 365, which 00:12:23.149 --> 00:12:26.549 basically allows me to start quickly without 00:12:26.549 --> 00:12:30.529 any machine setup. And this hosted browser runs 00:12:30.529 --> 00:12:33.490 in a Microsoft managed environment, but it is 00:12:33.490 --> 00:12:38.139 not Microsoft Entra. joined to your tenant or 00:12:38.139 --> 00:12:40.840 managed by your Intune policies. So this means 00:12:40.840 --> 00:12:43.240 that if you're trying to connect to your SharePoint 00:12:43.240 --> 00:12:47.100 site or to your OneDrive or a website that's 00:12:47.100 --> 00:12:49.259 internal, it's not going to be able to do that. 00:12:49.320 --> 00:12:51.299 But if you want to connect to a public site like 00:12:51.299 --> 00:12:54.299 I am to this ServiceNow developer site, it can 00:12:54.299 --> 00:12:57.580 connect to it, right? There is a way you can 00:12:57.580 --> 00:13:00.600 actually connect to your intro connected domain 00:13:00.600 --> 00:13:04.009 managed machine, which is right here. And it 00:13:04.009 --> 00:13:07.190 tells you how to go about doing that. We're not 00:13:07.190 --> 00:13:09.389 going to do that, but the documentation shows 00:13:09.389 --> 00:13:11.769 you how to do that if that's what your use case 00:13:11.769 --> 00:13:14.269 is for. So for us, we're just going to leave 00:13:14.269 --> 00:13:17.730 it as use hosted browser and then go ahead and 00:13:17.730 --> 00:13:20.289 select add and configure on the bottom here. 00:13:20.429 --> 00:13:22.669 Now we're in this section where we have details 00:13:22.669 --> 00:13:26.570 and inputs. And for the name of it, I want to 00:13:26.570 --> 00:13:33.960 say this is computer use to service now. okay 00:13:33.960 --> 00:13:41.840 description what does it do connects to the service 00:13:41.840 --> 00:13:49.399 now developer site that has employee vacation 00:13:49.399 --> 00:13:55.519 hours all right now here's where all the instructions 00:13:55.519 --> 00:13:58.539 come everything that i showed you we expect this 00:13:58.539 --> 00:14:01.059 to do in terms of go here click this do that 00:14:01.629 --> 00:14:03.190 this is where we're going to put the instructions 00:14:03.190 --> 00:14:05.590 now i've come up with the instructions because 00:14:05.590 --> 00:14:07.029 there's a bunch of them so i'm just going to 00:14:07.029 --> 00:14:10.129 copy and paste them okay so i just pasted everything 00:14:10.129 --> 00:14:12.769 in and let's take a look at these together right 00:14:12.769 --> 00:14:15.250 so first we're going to go to the particular 00:14:15.250 --> 00:14:18.129 website which is at developer .service .com so 00:14:18.129 --> 00:14:20.470 we're telling go there and if you're not logged 00:14:20.470 --> 00:14:23.509 in click sign in and then log in with my email 00:14:23.509 --> 00:14:27.059 and my password this is not a secure way of doing 00:14:27.059 --> 00:14:29.379 it but i'm doing it just because this is a demo 00:14:29.379 --> 00:14:32.100 what you're supposed to do officially is you 00:14:32.100 --> 00:14:35.480 go to this stored credentials section here and 00:14:35.480 --> 00:14:38.940 you add your credentials and this adds them to 00:14:38.940 --> 00:14:42.580 your azure key vault in a very secure way and 00:14:42.580 --> 00:14:45.320 then you can use them i didn't want to go about 00:14:45.320 --> 00:14:47.340 setting all this up because it's a lot of extra 00:14:47.340 --> 00:14:50.039 work so i'm just putting it straight in in the 00:14:50.039 --> 00:14:52.179 instructions which is again fine for the demo 00:14:52.179 --> 00:14:54.059 but not recommended if you're doing a production 00:14:54.059 --> 00:14:57.620 run on this so i put in my information my email 00:14:57.620 --> 00:15:00.679 and my passport and then step four i'm basically 00:15:00.679 --> 00:15:04.679 saying select the app engine studio go to this 00:15:04.679 --> 00:15:07.720 hr thing under your app select hrdv everything 00:15:07.720 --> 00:15:10.440 that i showed you earlier select preview And 00:15:10.440 --> 00:15:12.799 then search for the name that's being asked of 00:15:12.799 --> 00:15:14.820 you and click on that name in the first name 00:15:14.820 --> 00:15:17.759 column. Increase the hours booked by the field 00:15:17.759 --> 00:15:21.120 hours and decrease the hours left by the hours. 00:15:21.240 --> 00:15:24.720 So we're basically updating the number of hours 00:15:24.720 --> 00:15:27.440 in there. And then ultimately we are clicking 00:15:27.440 --> 00:15:30.820 an update. We don't want it to ask for permission 00:15:30.820 --> 00:15:33.259 because it has a tendency to ask for permission 00:15:33.259 --> 00:15:36.340 and then it kind of like stops and cancels out. 00:15:36.500 --> 00:15:39.370 And then once the update is complete, Tell me 00:15:39.370 --> 00:15:41.250 how many hours have been booked so far and how 00:15:41.250 --> 00:15:43.090 many are left. All right. So these are kind of 00:15:43.090 --> 00:15:45.529 all my instructions. If you guys are interested, 00:15:45.750 --> 00:15:48.309 I can put these in the comments or in the description 00:15:48.309 --> 00:15:51.289 somewhere so you have a copy of them. But that's 00:15:51.289 --> 00:15:56.090 basically what I'm telling it to do. Now, if 00:15:56.090 --> 00:15:59.370 I scroll down, there's some other sections of 00:15:59.370 --> 00:16:01.149 this that are important. We looked at the stored 00:16:01.149 --> 00:16:04.659 credentials. You can turn on allowing specific 00:16:04.659 --> 00:16:07.860 websites and desktop apps so that computer use 00:16:07.860 --> 00:16:10.799 is only limited to go to certain places. If you 00:16:10.799 --> 00:16:13.539 toggle this on, then you can say, look, from 00:16:13.539 --> 00:16:16.759 a website, you can go to this website, but you 00:16:16.759 --> 00:16:19.360 can't. So you can kind of like tell it which 00:16:19.360 --> 00:16:22.080 ones it's allowed as well as applications. We're 00:16:22.080 --> 00:16:24.580 leaving all that blank. And then from an inputs 00:16:24.580 --> 00:16:27.279 perspective. So if you remember in our topics, 00:16:27.340 --> 00:16:31.200 we actually have that person's name as a variable 00:16:31.200 --> 00:16:35.100 called name. and hours is hours and so here i'm 00:16:35.100 --> 00:16:37.539 going to go and create some inputs and i'm going 00:16:37.539 --> 00:16:46.779 to say name name of the person click done and 00:16:46.779 --> 00:16:50.679 then add another input and i'm going to put hours 00:16:50.679 --> 00:16:56.120 number of vacation hours to book so these are 00:16:56.120 --> 00:16:59.740 my inputs so you can see that they just got put 00:16:59.740 --> 00:17:04.970 in here hours and name And I think at this point 00:17:04.970 --> 00:17:07.849 in time, we're in good shape. So on the top right 00:17:07.849 --> 00:17:09.890 hand side, I'm going to go ahead and click save. 00:17:10.869 --> 00:17:15.450 Okay. Now, once this gets saved, you can actually 00:17:15.450 --> 00:17:19.630 go ahead and click test over here and test it 00:17:19.630 --> 00:17:21.650 out. But we're not going to do that. I'm just 00:17:21.650 --> 00:17:23.849 going to run it inside the agent and show you 00:17:23.849 --> 00:17:27.849 guys exactly what happens. Now, what we've done 00:17:27.849 --> 00:17:32.650 so far is we created this topic. And we added 00:17:32.650 --> 00:17:35.809 the tool of computer use with all these instructions, 00:17:36.150 --> 00:17:38.269 right? Now what we're going to do is we're going 00:17:38.269 --> 00:17:41.009 to select overview and we're going to go back 00:17:41.009 --> 00:17:42.890 and we're going to give this agent instructions. 00:17:43.430 --> 00:17:45.710 We're going to come to this instruction section 00:17:45.710 --> 00:17:47.690 and we're going to select edit and we're going 00:17:47.690 --> 00:17:54.230 to say, look, first use this. I'm going to put 00:17:54.230 --> 00:17:57.609 slash and I want to use this topic, booking vacation 00:17:57.609 --> 00:18:04.059 topic to find out for whom and how many hours 00:18:04.059 --> 00:18:12.420 are being asked to book then use slash computer 00:18:12.420 --> 00:18:14.940 use to service now the tool that we just added 00:18:14.940 --> 00:18:21.119 the computer use to make the changes to the service 00:18:21.119 --> 00:18:28.220 now database okay very simple save it and i think 00:18:28.220 --> 00:18:31.480 with that That's our agent that we just built 00:18:31.480 --> 00:18:36.160 using topics and the computer use. And you can 00:18:36.160 --> 00:18:39.400 see knowledge is blank. The tool is just that 00:18:39.400 --> 00:18:43.799 one tool. There is no triggers. However, autonomous 00:18:43.799 --> 00:18:47.640 is actually recommended for computer use, probably 00:18:47.640 --> 00:18:50.220 because computer use takes a long time and you'll 00:18:50.220 --> 00:18:52.940 see in a second. And then in terms of agents, 00:18:53.039 --> 00:18:55.539 like multi -agent orchestration, that's blank 00:18:55.539 --> 00:18:57.359 as well. So there's a bunch of sections blank 00:18:57.359 --> 00:18:59.460 in this, but that's okay. So what we're going 00:18:59.460 --> 00:19:01.759 to do now is we're going to select test. And 00:19:01.759 --> 00:19:05.420 then here I'm going to type in, I'd like to book 00:19:05.420 --> 00:19:12.319 vacation and see what happens. So first this 00:19:12.319 --> 00:19:14.319 computer use comes in, it comes in progress. 00:19:14.539 --> 00:19:18.339 Then my booking vacation topic gets initiated. 00:19:19.059 --> 00:19:22.140 And as you can see, it says, what is the first 00:19:22.140 --> 00:19:24.779 and last name and so i can pick these names that 00:19:24.779 --> 00:19:29.000 we put in let's put sammy belong and it says 00:19:29.000 --> 00:19:31.279 how many hours you want to book and i say i want 00:19:31.279 --> 00:19:36.400 to book 10 hours okay and now this is when the 00:19:36.400 --> 00:19:40.599 computer use is going to start and it says that 00:19:40.599 --> 00:19:43.559 computer use will begin as soon as a computer 00:19:43.559 --> 00:19:46.420 is available it's a hosted computer so let's 00:19:46.420 --> 00:19:50.630 give it a second and see what happens here Now 00:19:50.630 --> 00:19:54.130 you can see that right away there are screenshots 00:19:54.130 --> 00:19:57.049 that are being generated of what this computer 00:19:57.049 --> 00:19:59.430 use is doing and it's telling you step by step 00:19:59.430 --> 00:20:01.690 what it's doing. It's going to follow all the 00:20:01.690 --> 00:20:04.670 instructions that we gave it. So first it's opening 00:20:04.670 --> 00:20:08.609 a browser to access ServiceNow. It's going to 00:20:08.609 --> 00:20:11.990 File Explorer and then opening the browser. So 00:20:11.990 --> 00:20:13.849 it's going to kind of give you a play -by -play 00:20:13.849 --> 00:20:15.809 and it looks like it's actually in the browser 00:20:15.809 --> 00:20:18.890 now. It's going to go to that website. and this 00:20:18.890 --> 00:20:21.269 does take a little bit of time that's why autonomous 00:20:21.269 --> 00:20:23.910 is recommended for these types of computer use 00:20:23.910 --> 00:20:28.309 tools but we'll see how it does as time goes 00:20:28.309 --> 00:20:33.710 by all right looks like so far it's actually 00:20:33.710 --> 00:20:36.470 made it to that service .developer site which 00:20:36.470 --> 00:20:40.289 is good and now it's clicking in on the sign 00:20:40.289 --> 00:20:48.559 in on the portal okay so it looks like it actually 00:20:48.559 --> 00:20:52.940 got past this sign -in process over here and 00:20:52.940 --> 00:20:55.420 so now it's actually following the rest of the 00:20:55.420 --> 00:20:58.740 steps it's trying to get itself to this app engine 00:20:58.740 --> 00:21:02.640 studio section so so far so good it's continuing 00:21:02.640 --> 00:21:06.440 on and it's giving us a play -by -play as it 00:21:06.440 --> 00:21:24.079 goes on Alright, looks like it's making good 00:21:24.079 --> 00:21:26.079 progress. It actually made it all the way to 00:21:26.079 --> 00:21:29.000 this database section where Jane and Pete and 00:21:29.000 --> 00:21:33.319 everyone's there. And so now it's trying to get 00:21:33.319 --> 00:21:40.980 to Sammy Belong's information here. And it's 00:21:40.980 --> 00:21:54.000 updating the hours. it says updating hours left 00:21:54.000 --> 00:22:01.640 to 80. all right so this is it this is the final 00:22:01.640 --> 00:22:05.619 section and it says sami's hours already booked 00:22:05.619 --> 00:22:08.880 has been updated to 120 and hours left to 80 00:22:08.880 --> 00:22:11.380 and then the computer task is finished okay so 00:22:11.380 --> 00:22:16.579 we're looking for 120 and 80 for sami so if we 00:22:16.579 --> 00:22:19.380 go to our database and this is a moment of truth 00:22:19.380 --> 00:22:24.740 right so it says right now it's 110 and 90 so 00:22:24.740 --> 00:22:28.480 this should go up to 120 and this should go down 00:22:28.480 --> 00:22:31.160 to 80. let's let me refresh the screen see what 00:22:31.160 --> 00:22:39.880 happens here boom that's awesome it worked Maybe 00:22:39.880 --> 00:22:43.319 I shouldn't be surprised. Well, that's awesome. 00:22:43.440 --> 00:22:46.299 I'm happy about that. And if we kind of close 00:22:46.299 --> 00:22:48.960 this out and go back, this is one of the issues 00:22:48.960 --> 00:22:52.500 that I see with computer use, right? Now, people 00:22:52.500 --> 00:22:54.960 are not that patient, you know, maybe a couple 00:22:54.960 --> 00:22:57.700 of seconds. And you can see that this booking 00:22:57.700 --> 00:23:00.960 vacation, the topic took five seconds, but this 00:23:00.960 --> 00:23:05.160 took 283 seconds, essentially, right? It's a 00:23:05.160 --> 00:23:08.240 long time. And that's why it's recommended that 00:23:08.240 --> 00:23:10.819 autonomous is being used for computer use. So 00:23:10.819 --> 00:23:13.119 think about like autonomous things that you can 00:23:13.119 --> 00:23:17.059 do versus a real time thing that could take a 00:23:17.059 --> 00:23:19.200 long time like that. So that's essentially it. 00:23:19.279 --> 00:23:21.839 But one thing I wanted to mention as well is 00:23:21.839 --> 00:23:25.240 I actually had to go to the settings and I went 00:23:25.240 --> 00:23:27.579 down to this section here, which I showed before 00:23:27.579 --> 00:23:30.559 this content moderation level. And I brought 00:23:30.559 --> 00:23:34.980 it down to low instead of high. And then I ran 00:23:34.980 --> 00:23:37.180 it. And I don't know if I showed that earlier 00:23:37.180 --> 00:23:41.480 on, but experiment with that from high to low 00:23:41.480 --> 00:23:45.980 if you can get your computer used to work. And 00:23:45.980 --> 00:23:47.900 it might be because I actually had the username 00:23:47.900 --> 00:23:51.079 and password in my instructions. If you enjoyed 00:23:51.079 --> 00:23:53.880 this video, make sure to give it a like and consider 00:23:53.880 --> 00:23:56.720 subscribing. Drop any questions you have in the 00:23:56.720 --> 00:23:59.140 comments and I'll catch you on the next one.