Okay, so I had a clutch lever replacement that damaged my clutch sensor and all of a sudden this problem started. I had my clutch sensor replaced today and this issue seems to have disappeared.
This definitely seems related to the clutch sensor, maybe check that out.
Cheers,
Johan