Jim was born in Toledo, Ohio to Myrtle O. Rufty, and Willliam F. Rufty Sr. He attended Macomber High School where he played Football, & Baseball. Many people over the years said that he was the only left-handed catcher they ever knew. Jim served in the U.S. Air Force for 4 years Active Duty and 2 years Reserve Duty. Jim served as a Radio Operator in Chateauroux, France, and played baseball for the Air Force while traveling throughout Europe. His Coach tried to get him to play first base, but he told him he was a catcher…he got his way.

Jim spent most of his career in the Restaurant Business. He was the Vice-President of Operations for one of the largest Wendy's Franchises in the nation at the time. He left Wendy's franchise with one of its partners to open The Earl of Sandwich, a full-service restaurant in Colorado Springs, Colorado with 3 Dining Rooms with views of Pike's Peak on Colorado Blvd., just down the street from The U.S. Air Force Academy. They then bought franchise rights for the Restaurant Chain Le Peep, now known as Scramblers, and opened the first two stores in Toledo on Secor at Westgate, and Airport & Reynolds. Jim then went into a partnership with his nephew, Greg Rufty, and former GM of Le Peep. Kevin Marsh and they opened the Hungry Hobo on Conant Street in Maumee in the old Victoria Station.

Jim's love of music led him to purchase a commercial karaoke system for this restaurant which he then built into a business of its own doing as many as twenty shows a week at bars throughout Toledo, NW Ohio, and SE Michigan. His last job was back working for his nephew at Extra Virgin Food Services where he delivered school lunches until he was 83.

Jim was preceded in death by his mother & father, Myrtle O. Rufty, and Willliam F. Rufty Sr, Brother, William F. Rufty Sr., Wife, Lisa Rufty, & niece, Maureen A. Rufty. He is survived by his sister-in-law, Sherry A. (Bellair) Rufty, niece, Jodie Rufty-Graux (Angelique), nephew, Gregory A. Rufty (Maria Reiter), great-niece, Megan E. Rufty (Ben Shiple), great great niece Annie, and great nephew, Brendan A. Rufty (Savannah Hurst).

A celebration of life will take place on Sunday, August 3, 2025, at Chateau Louise in Luna Pier, Michigan, from 12:00 p.m. to 2:00 p.m.