Need legal advice on custody.?

my sons dad and i have joint custody with me having primary care, i wanted him to have visitation...the problem is he never wants to take him on his weekends unless i physically drive our son to and from his place and supply him with everything (including food) in our paper work it says that he needs to supply everything. he use to live with me and used my computer alot so alot of his stuff is still on here. i ran across a few emails today between him and his mom talking about me...and it wasnt very nice at all they were calling me a ***** saying i am ungreatful (after i let her daughter/his siter and her kid live here for four months for FREE!) i replied back to the email and nicely asked them to keep my name out of their conversations. but i am at a point where i am tired of having to beg him to take his son and i am tired of all the drama that comes with their family i really feel my son deserves better than this. i have voicemails of him screaming at me because i woudlnt give him a ride or money. i used to have a restraining order on him. he has two domestics against me, 4 possession charges and an owi. with everything going on with the slander, threatening me and him not doing what i paper work says can i legally file again for full custody or sole custody? its not finalized just yet because he refuses to take the child in the middle cl (which i have already done) please someone hlep my child deserves so much better, what should i do?