GenAI Essentials – Full Course for Beginners - Ep160

youdo things three times then youabsolutely know how to do eminem 2024 newsit and it'sit's uh locked into your core memory sowe'll goahead and we'll do this one more timeand I know this time it will workand we'll go ahead and launch aninstance I'm going to say opa 3 as thisis our third attempt we're going to goover tobuntu and we'll saym7i and so yeah we have 8 gigabytes andso this is going to be four vcpus Idon't know why I tried to do it withless I just thought it might work sowe'll checkbox both of these we'll godown below we'll go to Advanced detailswe'll choose our instance profile soit'sSSM and we'll go over to here and thenwe'll go ahead and launch theinstance and so we will do as wenormally do and just wait a little bitfor this instance to be ready okay andyou know what I already made a mistakebecause when we launched that instance Iforgot about the storage size so I'mgoing to go do it again for the fourthtime this time I'm going to get it forcertain there's no way I'm not going toget it here but you know practice makesperfect we'll go here and we'll saylaunch instanceOpa 4 whoops four we'll go over to abuntu we'll choose the size it'll bem7i xlarge I'm going to scroll on down we'regoing to proceed without a key pairwe'll choose these two here we'll choose30 30gigabytesand then we'll go down here so this onehas16 gigabits of ram the other thing thatI was kind of wondering is that you knowdid we run out of storage space I'mgoing to just jump this up to 40 just incase just in case and then we're goingto make our way over to ec2 SSM roll andso now we should have everything eventhe the firewalls are open we'll goahead and launch it and this time thistime it will work it has to work I don'twant to re-shoot thisvideo um but these are the commonproblems I almost always run with themand that's why I'm not starting overbecause I know that these are the commonissues that I run into and I think it'sworth showing that stuff off but we dohave to wait for um this to pass thoseinitial one so we'll have to wait a acouple minutes here all right so let'sgo ahead and connect uh to this instancenow it should be ready sometimes thishappens with sessions manager I justclick back and forth and now it willallow us to connect to it but at thispoint we should be uh super experts ingetting this configured so we'll goahead and type inpseudo pseudo hyphen SuUbuntu and I'm going to go back backover whoops pseudo suyenubu and I'm going to go back over tohere and I still have the key in thereso I'm going to now I'm really going forit I'm going to go all the way down likethis I'm justgonna wonder I just single shot thishere let me go here and adjust this likethis okay and if I grab thishere TR it in and we will just singleshot that there I'll just undo this so Istill have those groupsokay we'll just wait for this tocomplete all right soum we ran all that yeah it looks like weare okay here so I'm going to go aheadand just make sure that it ran the lastone uh it does not look like it's in thecorrect location as um I expected so wedid run all this stuff but I have afeeling it hit this and then it didn'twork so I'm going to go ahead and copyand paste this you got to pay closeattention of what's going on here um I'mgoing to go ahead and do thisI'm just going to cat out the uh thatfile there that was replaced excellentand so now we're going to do our Dockercompose up and this time this time forcertain it's going to work we'll goahead and hit enter and we are going topull thoseimages okay so we'll wait for them topull and then we'll do the same thing wedid before which is looking at theactualum uh TGI service and make sure thatit's launched all right and so you knowit's starting to it pulled all thecontainers and it's just creating themnow and we're just going to wait tillthey're in a started State and so therewe go we can do our DockerPS uh but of course we want our nicerline here so grab that onehere we'll paste that on in and so I'mlooking for TGI service right and we'regoing to do Docker P or logs and whoopsit did not copy we'll try this againright click copy right click pastesometimes that's what you got to do butthen I get all this weird output that'sjust fine we'll go ahead and do that sowe're now downloading it we'll just haveto wait a few minutes but I think thistime uh we're not going to have an issuebecause you know we'll have enoughmemory enough CPU enough storageokay all right so um let's go take alook and see if the model is in arunning State I've been waiting a littlebit and now it says it's connected so weare now in good shape it says invalidhost name defaulting to 000000 so thathost name we set didn't like it butthat's that's okay because 0000 is goingto work for us as well there's a fewdifferent ways that we can interact withthis model but the way that we reallywant to interact with it is from uh theweb interface so this thing is beingserved on a public IP address hopefullyyou have a public IP address if youdon't you're going to have to run itagain and I'm going to go over to hereand hit enter and so I should in theoryget an interface and I do and so we havethe chat Q&A now I'm told that this canhandle rag with some particulardocuments but I'm going to go say hellolet's see what it does let's say hellohow can I assist you today and so it'srunning totally fine I would love to tryout the rag um I always

(Editor: cpp)