What you describe is exactly replacing the workers. When people say "AI will replace X" they don't mean there won't be X ever again, but that the numbers will shrink significantly.