Graph Based Deep Reinforcement Learning Aided by Transformers for Multi-Agent Cooperation