Valencia manager Gary Neville says it is "ridiculous" to suggest the club's fans want him to leave despite their poor form.