That sounds like the correct procedure, assuming the link is valid and not mangled in some way.
It's possible it's occurring with sites that don't like "hot linking".
Those are sites that don't want people linking to individual objects on their pages from other web sites. Some web servers are setup to reject requests that are detected as such.
Have you asked the magical little fairy?