Addressing the issues related to the lack of proactive and in-process regulatory oversight, as well as the lack of dynamism in regulatory measures within organic agricultural product quality traceability systems, this study explores regulatory governance strategies with blockchain technology embedded. It proposes using blockchain’s consensus mechanism to enforce fraud punishment, blockchain’s incentive mechanism to implement reputation scoring mechanisms, and blockchain’s smart contracts to realize deposit mechanisms, thereby promoting cooperation among stakeholders in the organic agricultural product supply chain and achieving the integration of organic traceability and supervision. An evolutionary game model is constructed between producers and processors of organic agricultural products in the organic agricultural products supply chain system to analyze the decision-making of each subject, the interaction patterns between the two parties’ decisions, and the optimal strategic choices under the multiple regulatory mechanisms. Taking Wuchang rice as a research case, the relevant conclusions and changes are verified and analyzed. The research results show that the embedding of blockchain can effectively improve trust relations between organic product manufacturing enterprises and processing enterprises, promote honest transactions, enhance the pre- and post-governance levels of organic agricultural product supply chains, and facilitate the practical application of blockchain technology.