GenAI Essentials – Full Course for Beginners - Ep158

usethat one because the Intel one is practical ml coursejustgiant but what we're looking for here isthe name so I'm just grabbing this parthere I'm going to go ahead and copy itokay and I'm just going to go ahead andtry to paste this into place and thatlooks perfect okay and we can use thisas our embedding model we don't have tochange it because the embedding isreally more important for the rag and umyeah it's not going to be an issue sothis is all I wanted to change I'm goingto do Cole and w q and quit there and sothat is now set so these lines um thisbasically does the same thing kind ofexcept uh this one's a bit inaccuratebecause it's supposed to oh it does itswaps out both the lines there perfectso you can run this if you wantum and so now we want to actually runthis so we'll need to run these twolines I'm going to go ahead and copythat and we'll go ahead and hit pasteand hit enter I'm going to make my wayback over to here and we're going to goahead and copy this line and we'll putenter okay and so now what it's doing isit's pulling down all these umcontainers so these are all the onesthat running retriever Tei rerankingservice redus Vector database TGIservice all this stuff so if we were togo over to the OPAdocumentation okay we went over to hereand we went over to here um and we wentto go into chatQ&A actually you know what I want thedoc so we'll go toop. and if we go over to technicaldocumentation on the left hand sidewe'll go into examples and I'm going togo to chat Q&A sample we'll go tooverview okay and so down here we scrollon down this is basically what it'sdeploying it's deploying a bunch ofthese different kinds of containers allorchestrated together um and if we goback over to here it's now finishedpulling it says no space left on thedevice oh no I forgot to launch thiswith enough space so one thing that Iforgot to do is when we launched the cc2instance I had to make surethat had enough storage and it doesn'tum so I'm going to haveto do this whole thing over so I'm goingto go ahead and terminate this but heywe got the first run down so that'spretty good it's not that big of a dealit's not like it takes that long so I'mgoing to terminate this instance I'mgoing to go back over to ec2 and we'llgo ahead and launch a newone practice makes perfect right I'mtelling you it's easier to just launch anew instance than than it is to try toresize the the uh the disc becausethere's a little bit more work we'd haveto do I'm going to name it this timejust say opa chat chat q&name and so we're going to go here andchoose abuntu and that one's fine I'm going togo here and we saidm7iM7I no I didn't say I was going to removeanything I'm not sure what they'retalkingabout this thing is running a little bitslow I'm not sure what's going on hereum I don't know what's going on so I'mgoing to go back to instances here I donot TR it I'm going to go launchinstances and we'll just sayopa I'm choosingUbuntuokay I'm not sure what it's trying tospin there we go and so now we'll openthis up I'll type inm7i and we're going to do large I'venever used it with um a large but Ithink that should be proficient normallyyou want to have at least four vcpuswhen you're running something like aseven bilon parameter model I'm going togo with a key parameter we're not we'rejust running a one billion parametermodel so that's pretty easy so we'llselect these two here and we only haveeight gigabytes now we saw it was only 4gigabytes but there's not just thatthat's downloading there's a bunch ofmodels and so I'm going to move this upto 30 gabt which I believe is the freetier actually says it right there so Istill am in the free tier at least forstorage not for compute um and I'm goingto go down here and I'm going to go backand choose that imalagain um so this one'scalled whichever and I showed you howyou can make that yourself we'll goahead and launch this instance and thistime I think we're going to have it sowe'll wait for that to launchokay and we'll wait for it to getinitialized but yeah it's not that baduh having to redo this but we'll justwait a moment here okay all right so umthe OPA is running we'll go ahead andconnect and we'll go ahead and dothis and this time we're going to get itright I think I kept the yep the tokenaround so my life is not super painfulheresometimes it takes uh two runs to dosomething but that's okay we're learningby doing something more than once okayso we're back into here we're going togo back over to our instructions and wewant to do all this I'm going to goahead I'm going to be risk a and I'mgoing to try to take that entire blockand paste it in here and see whathappens okay and hopefully it justworks I have had this like where I'veused it completely and just run it endtoendokay so I need to go grab my keys I'mgoing to go ahead and do that I'm justgoing to paste it into here and we'llgrab this blocksnextokay and we'll give that a moment torun I'll just pause here when it's donethere we go so I'm going to go ahead andpaste this part in next we'll go aheadand hit enter that's just getting usinto the Intel Zeon processor area andsetting that hugging face value uh wecan run this we can run this I just wantto make sure that it absolutely worksproperly so I'm going to go ahead andcopy this I'm G to go ahead and pastethis in here and what I'm going to dolike we really really want to check thisI'm going to go ahead and type in setcat EnV

(Editor: solidity)