I'm not sure if this is the type of criticism you were looking for, but I found the paper Concrete Problems in AI Safety fairly interesting. It points out a number of ways modern ML systems, especially RL, could be prone to accident risk: reward hacking, distributional shift, etc.