Remove support for python3.5
This PR removes formal support for python3.5.
This is partly to support #1139, which will bump the matplotlib requirement to 3.1.0, which is only supported on python >=3.6, but also allows us a couple of improvements, mainly in testing.