During Middle School.

Oikawa hated the fact someone was joining the team. The person he hated after not seeing him in a long time saw him again in high school when they had a match against them. that's where the feelings kicked in. Someone he hated his whole time in middle school became a crush.