Electronic Health Records (EHRs) play a critical role in ensuring effective patient care and treatment. The medical information is very sensitive in nature and it requires secure storage and distribution. But existing methods suffer from data ownership problems which leads to privacy and security issues. To address these problems, this paper proposes a federated blockchain based EHR system. It uses public key-pair infrastructure (PKI) to generate public-private key pairs which enables the secure exchange of information. To make it more efficient, data is divided into public state and private state based on its nature of sensitivity. Public state data are present in raw form. But private state data is encrypted using the public key of intended peers and can only be decrypted with their respective private keys. This dual-state design ensures robust confidentiality while enabling controlled access, thereby maintaining the delicate balance between privacy and data availability within the network.