If the allegations, even if true, wouldn’t meet the definition of harassment or break a workplace policy, you might decide not to move forward with a full investigation.
That said, these situations aren’t always clear-cut. It’s often a good idea to get some advice before making that call, just to make sure nothing important is being missed.