The left-back also reveals that he was not allowed to leave the club on loan to gain experience and insists that he wants to be part of Team GB's Olympic squad this summer