In order to meet the requirements of performance heterogeneous computing systems, intelligent systems, and data centers for low-latency, high-throughput, and low-overhead data resource sharing capabilities, a PCIe-based multi-node efficient interconnection mechanism was proposed. We propose a PCIe-based interconnection framework, and adopt the native PCIe switching channel and cross-node efficient interconnection mechanism to design and implement the functions of memory sharing, reflective memory, RDMA and other functions between distributed heterogeneous node device resources. The proposed interconnection mechanism is able to ensure the efficient flow of batch data between different task nodes, and maximize the efficiency of equipment resource collaboration within the potential area. In the final performance analysis, the proposed PCIe-based multi-node efficient interconnection mechanism is tested, and the RDMA data transmission rate can reach 48.65 Gb/s with x8 lanes, which is better than the transmission bandwidth of Ethernet.