Middlesbrough head coach Steve Agnew says his team have not given the fans enough this season after his relegated side lost 2-1 to Southampton.