That's not correct. If you trade on information tipped to you by insiders, you are also guilty of insider trading, even though you didn't have any fiduciary duty towards the company.
If you overhear insiders discussing something, say in a restaurant, you aren't an insider (and I believe there is case law on just that point). In general, you need to have encouraged or conspired with the leaker, if I understand correctly.