Either you can mention isnull i.e.
SELECT AVG(ISNULL(VoteValue,0)) AS [AverageVoteValue] FROM Vote
WHERE TeamID=@TeamID and CardID=@CardID and LastModifiedDateTime between getDate()-7 and getDate()
OR
you can add a condition like what
MUKUL GOEL said.