Brown enlisted in the U.S. Navy during the American Civil War. In 1863, he was serving as quartermaster aboard the 378-ton, screw-propelled wooden gunboatUSS Albatross during the U.S. Navy's attack on Fort DeRussy, Louisiana on May 4. Despite sustaining heavy enemy fire that day, which included the projection of a ball from a 32-pound cannon through the wheelhouse of the Albatross which blew off the ship's wheel and exposed the ship's relieving tackles, the ship's officers and enlisted men were still able to capture the fort's heavy works and inflict serious damage on two Confederate steamships, the CSS Grand Duke and Mary T.[4] For his efforts that day, which involved operating the relieving tackles under withering fire in order to move his ship out of harm's way, Brown was later awarded the U.S. Medal of Honor.[5][6] The award of Brown's Medal of Honor was announced via General Order No. 32 on April 16, 1864:[7]
Awarding medals of honor to—
J. K. L. Duncan, orindary seaman, Fort Hindman.
Hugh Melloy, orindary seaman, Fort Hindman.
Wm. P. Johnson, landsman, Fort Hindman.
Bartlett Laffey, seaman, Petrel.
Jas. Stoddard, seaman, Marmora.
Wm. J. Franks, seaman, Marmora.
Richard Seward, paymaster's steward, Commodore.
Christopher Nugent, orderly sargeant Marines, Fort Henry.
James Brown, quartermaster, Albatross.
William Moore, boatswain's mate, Benton.
William P. Brownell, cockswain, Benton.
John Jackson, ordinary seaman, C. P. Williams (*Awarded under an erroneous report—not entitled to it)
William Talbot, captain forecastle, Louisville.
Richard Stout, landsman, Isaac Smith.
Geo W. Leland, gunner's mate, Lehigh.
Thos. Irving, cockswain, Lehigh.
Horatio N. Young, seaman, Lehigh.
William William, landsman, Lehigh.
Frank S. Gile, landsman, Lehigh.
Michael Huskey, fireman, Carondelet.
John Dorman, seaman, Carondelet.
William Farley, boatswain's mate, Marblehead.
Chas. Moore, landsman, Marblehead.
James Miller, quartermaster, Marblehead.
Robert Blake (colored), powder boy, Marblehead.
Medal of Honor citation
Served on board the U.S.S. Albatross during action against Fort De Russy in the Red River Area on May 4, 1863. After the steering wheel and wheel ropes had been shot away by rebel fire, Brown stood on the gun platform of the quarterdeck, exposing himself to a close fire of musketry from the shore, and rendered invaluable assistance by his expert management of the relieving tackles in extricating the vessel from a perilous position, and thereby aided in the capture of Fort De Russy's heavyworks[1][8][9]
^"USS Albatross (1861–1865)", in "Online Library of Selected Images: U.S. Navy Ships". Washington, D.C.: Naval Historical Center, U.S. Department of the Navy, retrieved online August 21, 2018.
^"James Brown", in "USS Albatross", in "The US Navy at Fort DeRussy". Cottonport, Louisiana: Friends of Fort DeRussy, retrieved online August 21, 2018.
"USS Albatross (1861–1865)", in "Online Library of Selected Images: U.S. Navy Ships". Washington, D.C.: Naval Historical Center, U.S. Department of the Navy, retrieved online August 21, 2018.