A Series of Letters, in Defence of Divine Revelation In Reply to Rev. Abner Kneeland's Serious Inquiry into the Authenticity of the Same. To Which is Added, a Religious Correspondence, Between the Rev. Hosea Ballou, and the Rev. Dr. Joseph Buckminster and Rev. Joseph Walton, Pastors of Congregational Churches in Portsmouth, N. H.
The Divine Right of Church Government Wherein it is proved that the Presbyterian government, by preaching and ruling elders, in sessional, Presbyterial and synodical assemblies, may lay the only lawful claim to a divine right, according to the Holy Scriptures
The Auchensaugh Renovation of the National Covenant and Solemn League and Covenant With the Acknowledgment of Sins and Engagement to Duties, as They Were Renewed at Auchensaugh, Near Douglas, July 24, 1712. (Compared With the Editions of Paisley, 1820, and Belfast, 1835.) Also, The Renovation of These Public Federal Deeds Ordained at Philadelphia, October 8, 1880, by the Reformed Presbytery, with Accommodation of the Original Covenants, in Both Transactions, to Their Times and Positions Respectively
The Book of Religions Comprising the Views, Creeds, Sentiments, or Opinions, of All the Principal Religious Sects in the World, Particularly of All Christian Denominations in Europe and America, to Which are Added Church and Missionary Statistics, Together With Biographical Sketches
The Juvenile Bible: Being a brief concordance of the Holy Scriptures, in verse. Containing a summary of all the chapters in the books of the Old and New Testament, from Genesis to the Revelation, alphabetically arranged, and admirably adapted to the comprehension and retention of young readers.