Great implementation! What is the run time for calculating the CLIP embeddings per image? And inference latency? Were any low-level model optimisations made for it to run on iOS hardware or am I deeply underestimating the power of these new chips lol
TheIdesOfMay t1_j28qz2q wrote
Reply to [P]Run CLIP on your iPhone to Search Photos offline. by RingoCatKeeper
Great implementation! What is the run time for calculating the CLIP embeddings per image? And inference latency? Were any low-level model optimisations made for it to run on iOS hardware or am I deeply underestimating the power of these new chips lol