Across the river from New York City, a charming riverside New Jersey borough offers budget-friendly accommodations, great ...