(19Mar2024)Ai project hardware advise from Nong + Thoughts on cloud computing
-[6/3] Talked with Nong on phone to describe the notebook computer need for AI project, Nong then talked with Suzanne in person.
-[19/3] WhatsApped Nong again for his advise in all and here are the details:
Link from Nong:
Educational discount:
[19/3]
1)As mentioned before, a laptop may not be a good hardware to run the Ai model since it is rather hard to maintain in hardware and the local storage is always limited. I would suggest to save the budget for a cloud computing / desktop server.
2) As I saw Suzanne filled in the work schedule that she is downloading the Ai model for efficiency testing. I think it is rather ineffective and time consuming to do just for a test. There are quite a bit of choice of cloud Ai interface can be choose form:
a) Amazon AWS has many build-in Ai models that can be used for test on hand, including the LLAMA that Suzanne want to test for:
Also there are many pre-build model that can be test and use, and the pricing is per hour of use:
Also free trial available: https://aws.amazon.com/tw/free/?nc2=h_ql_pr_ft&all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc&awsf.Free%20Tier%20Types=*all&awsf.Free%20Tier%20Categories=*all
b) Vertex Ai is an other choice of cloud computing from google:
Vertex use another type of pricing calculation
3) I would suggest Suzanne to take a look and make some report (in written/ ppt form) for comparison on developing our custom Ai system local and/or on cloud (Time/ cost/ efforts). Personally I think a mixed model would be most practical, but it needs much more details and information that needs to be collected.
留言
張貼留言