Neural networks with any non-linear activation should do the job, periodic activations are not necessary.

Also if you have to predict the sine wave, don't do neural networks. Try simpler learning algorithms, neural networks are mostly overkill. Imho kernel regression or something should be an easier way to go, but as always, can't guarantee without trying