begin, start, commence
end, finish, conclude
More vocabulary at the same HSK level as 始终.
More common words that include characters from 始终.