I created a div element, that I placed all the way on the right of my site. The only problem is that its at the top of the site, so if i scroll down it remains
Use position: fixed instead of position: absolute.
See here.
You can do this replacing position:absolute; by position:fixed;.
There is something wrong with your code.
position : absolute makes the element on top irrespective of other elements in the same page. But the position not relative to the scroll
This can be solved with position : fixed This property will make the element position fixed and still relative to the scroll.
Or
You can check it out Here
Change position:absolute to position:fixed;.
Example can be found in this jsFiddle.