In order to improve the resource allocation ability of optical network for massive and differentiated power services and reduce the algorithm training time of large-scale services, smart grid optical network resource allocation scheme based on MADDPG. The large-scale and differentiated power services were considered, the optical core network slice model of smart grid was built and the optimization problem aiming at maximizing the income of power grid companies was proposed. Conditional judgment mapping is proposed to simplify the optimization problem. At the same time, the improved MADDPG algorithm was designed to reduce the training time and meet the real-time needs of the network by placing different services to different agents. Lastly, simulation results show that the proposed algorithm has better reward, lower cost and delay, and lower training time.