This paper contributes to discussions within the energy justice literature on the need for changing accountability relations between policymakers, companies and citizens to promote just and democratic energy transitions. Moreover, it builds on insights from scholars who argue for a view on conflicts around energy projects as sites of self-organized participation where institutional reconfigurations may be initiated. Informed by critical dialogical accounting and accountability (CDAA), we contribute to these debates by examining a conflict around prospecting for critical minerals in Sweden, showing how local abilities to hold powerful actors accountable emerged as the project evolved. We highlight mobilising accountees, constructing central issues, targeting spaces and accountors, and identifying timings, as emerging accountee-abilities that shape accountability relations 'on the ground' and who has a say in energy projects.