Commit graph

136 commits

Author SHA1 Message Date
Warner Losh d0b2dbfa0e Remove $FreeBSD$: one-line sh pattern
Remove /^\s*#[#!]?\s*\$FreeBSD\$.*$\n/
2023-08-16 11:55:03 -06:00
Baptiste Daroussin 2f6f9eec38 locales: fix installation of some collation files
When the unicode locales files where split off the non unicode locales
be_BY.ISO8859-5 and ca_IT.ISO8859-15 where non installed one due to
a typo, the other one was just missing its entry in the Makefile.

It was only notice a year later, by some postgres developpers as it was
breaking some of their tests.

Reported by:	tmunro
2022-04-05 09:19:31 +02:00
Emmanuel Vadot 86c71e97d1 pkgbase: locales: Also tag the files dir
Otherwise bsd.dirs.mk will create the directory with the default
package (utilities) and we end up with a bunch of empty dirs managed
by this package while it shouldn't be the case.
2021-08-06 14:37:45 +02:00
Baptiste Daroussin 0fa5403d49 pkgbase: move locales into their own package
The only exception here being C.UTF-8 as this is the default
locales so it needs to always be installed

Reviewed by:	pkgbase (emaste)
Differential Revision:	https://reviews.freebsd.org/D31397
2021-08-03 18:35:26 +02:00
Baptiste Daroussin 30e1773fde locales: fix abuse of bsd.dirs.mk
the way SAMEDIRS was defined was an abuse of bsd.dirs.mk resulting in
all the directory to be created in one single command, but DESTDIR is
only prepend once on the first element of the list

Switch to the properway to use bsd.dirs.mk
2021-08-03 18:02:15 +02:00
Baptiste Daroussin 8232bb3859 locales: fix typo preventing installation of collation for ru_RU.CP866 2021-08-03 14:37:26 +02:00
Baptiste Daroussin 184d64af13 locales: stop hardcoding the directories in the mtree
The framework knows how to create directories and tag them properly
for a the creation of a mtree, not need to hardcode all the locales
entries in bsd.usr.mk

This simplifies addition of new locales but also allow people building
with WITHOUT_LOCALES to end up with a directory full of empty files
2021-08-03 14:25:00 +02:00
Baptiste Daroussin 0a36787e4c locales: separate unicode from other locales
Unicode locales are maintained and to evolved in cldr.
Generating the other locales from the unicode gets more and more painful
over the time.

Let's freeze the other locales to cldr 34.0.
2021-07-23 16:58:20 +02:00
Thomas Munro cc7edd258c Add collation version support to querylocale(3).
Provide a way to ask for an opaque version string for a locale_t, so
that potential changes in sort order can be detected.  Similar to
ICU's ucol_getVersion() and Windows' GetNLSVersionEx(), this API is
intended to allow databases to detect when text order-based indexes
might need to be rebuilt.

The CLDR version is extracted from CLDR source data by the Makefile
under tools/tools/locale, written into the machine-generated Makefile
under shared/colldef, passed to localedef -V, and then written into
LC_COLLATE file headers.  The initial version is 34.0.
tools/tools/locale was recently updated to pull down 35.0, but the
output hasn't been committed under share/colldef yet, so that will
provide the first observable change when it happens.  Other versioning
schemes are possible in future, because the format is unspecified.

Reviewed by:	bapt, 0mp, kib, yuripv (albeit a long time ago)
Differential Revision:	https://reviews.freebsd.org/D17166
2020-11-08 02:50:34 +00:00
Yuri Pankov ea22b5bd75 Add ga_IE.UTF-8 locale.
PR:		228587
Submitted by:	Micil <micheal.maclochlainn@oegaillimh.ie> (LC_TIME)
Reviewed by:	bapt
Approved by:	kib (mentor, implicit)
MFC after:	3 days
Differential revision:	https://reviews.freebsd.org/D17997
2018-11-26 19:39:49 +00:00
Yuri Pankov 1ade1c4113 Update to CLDR 34 and UNICODE 11.
Discussed with:	bapt
Approved by:	kib (mentor)
MFC after:	1 month
2018-11-03 22:02:10 +00:00
Yuri Pankov 4644f9bef6 Add -b/-l options to localedef(1) to specify output endianness and use
it appropriately when building share/ctypedef and share/colldef.

This makes the resulting locale data in EL->EB (amd64->powerpc64) cross
build and in the native EB build match.  Revert the changes done to libc
in r308170 as they are no longer needed.

PR:		231965
Reviewed by:	bapt, emaste, sbruno, 0mp
Approved by:	kib (mentor)
Differential Revision:	https://reviews.freebsd.org/D17603
2018-10-20 20:51:05 +00:00
Baptiste Daroussin fe90c6bf15 Update to CLDR 32 and Unicode 10
MFC after:	2 weeks
Relnotes:	yes
2017-11-03 13:52:34 +00:00
Baptiste Daroussin 50502545ce Readd Big5: some large databases setup are still requiring it.
Reported by:	"張君天(Chun-Tien Chang)" <tcs@kitty.2y.idv.tw>
2017-04-20 18:21:50 +00:00
Baptiste Daroussin ababdab0ce Remove zh_TW.Big5 locale
After discussion with many Taiwanese, in IT or not. Big5 is not used anymore.
It is not able to represent lots of the characters used in the language.
2017-03-19 17:52:46 +00:00
Enji Cooper e44885ac01 share: normalize paths using SRCTOP-relative paths or :H when possible
This simplifies make logic/output

MFC after:	1 month
Sponsored by:	Dell EMC Isilon
2017-03-04 11:26:40 +00:00
Baptiste Daroussin 28fded59b4 Update locales cldr to v30.0.3 and unicode to 9.0.0
MFC after:	1 month
Relnotes:	yes
2016-12-18 04:17:13 +00:00
Baptiste Daroussin 3c2db7e010 Add the forgotten "svn mv" from r302329
Reported by:	Ivan Klymenko <fidaj@ukr.net>
Approved by:	re (implicit)
2016-07-03 19:31:21 +00:00
Baptiste Daroussin 3cf6509d70 Posixify the locales name for variants
For all locales with variants:
- if no ambiguity on the locale (only one variant) just use the regular name
- if ambiguity, pick one as default and append @<variant> to the others
  respecting POSIX

As a result:
- All the 3 components locales added recently are renamed to the usual 2
  components version for all but sr_RS.UTF-8
- Set sr_RS.UTF-8 to the cyrillic variant
- Add sr_RS.UTF-8@latin
- Remove the symlinks aliases they were created to represent the 2 components
  version as aliasas and are now useless
- Update the OptionalObsoleteFiles.inc and ObsoleteFiles.inc to reflect those
  changes

Discussed with:	ache@
Approved by:	re@ (gjb)
2016-07-03 18:21:11 +00:00
Baptiste Daroussin d8fd68b648 Regenerate the Makefile so that actually the new generated collation are
properly installed
2016-04-16 19:39:51 +00:00
Baptiste Daroussin 110cf8a6f1 Regenerates locales Makefiles and locales 2016-04-16 17:55:11 +00:00
Baptiste Daroussin f8fd13a099 Simplify the locale generated Makefiles by using bmake multi variables for loops 2015-12-18 21:34:28 +00:00
Bryan Drewery 393608176b META MODE: Fix 'make the-lot' with recent locale changes
Sponsored by:	EMC / Isilon Storage Division
2015-11-25 19:13:28 +00:00
Baptiste Daroussin 1d211085ac Bring back a couple of ISO8859-15 locales:
- af_ZA.ISO8859-15
- en_AU.ISO8859-15
- en_CA.ISO8859-15
- en_NZ.ISO8859-15
- en_US.ISO8859-15
- fr_CA.ISO8859-15
2015-11-16 12:58:47 +00:00
Baptiste Daroussin c1c9ab6707 Regenerate locales after readding ISO8859-1 for locales that have ISO8859-15
Requested by:	arche
2015-11-15 14:51:10 +00:00
Bryan Drewery d4ea5890a8 Use explicit filename when creating locale symlinks to avoid creating a
directory symlink when the target directory does not exist.  This will
cause an error instead of a broken setup.

Sponsored by:	EMC / Isilon Storage Division
2015-11-11 18:45:48 +00:00
Baptiste Daroussin 3c3feed41a Merge from head 2015-11-01 21:17:38 +00:00
Bryan Drewery 7d8f797b72 Use more appropriate ${SHAREDIR} rather than /usr/share.
MFC after:	2 weeks
Sponsored by:	EMC / Isilon Storage Division
2015-10-27 23:35:02 +00:00
Baptiste Daroussin 7cefd8ca2a Regenerate locales 2015-10-13 20:24:57 +00:00
Baptiste Daroussin 1a41e1f147 Add newly generated locales from CLDR 27.0.1
only skip timedef until I figure out how to workaround svn painful mime-type handling
2015-08-08 01:45:53 +00:00
Simon J. Gerraty ccfb965433 Add META_MODE support.
Off by default, build behaves normally.
WITH_META_MODE we get auto objdir creation, the ability to
start build from anywhere in the tree.

Still need to add real targets under targets/ to build packages.

Differential Revision:       D2796
Reviewed by: brooks imp
2015-06-13 19:20:56 +00:00
Simon J. Gerraty d083cb1104 Ensure SYMLINKS fully specified
Differential Revision:       D2748
Reviewed by: brooks
2015-06-11 21:09:03 +00:00
Simon J. Gerraty 44d314f704 dirdeps.mk now sets DEP_RELDIR 2015-06-08 23:35:17 +00:00
Simon J. Gerraty f5f7c05209 Updated dependencies 2013-02-16 01:23:54 +00:00
Simon J. Gerraty 63478911d0 Include the target filename in SYMLINKS to avoid any confusion about
what is dirname and filename.
2013-01-23 00:49:05 +00:00
Marcel Moolenaar 7750ad47a9 Sync FreeBSD's bmake branch with Juniper's internal bmake branch.
Requested by: Simon Gerraty <sjg@juniper.net>
2012-08-22 19:25:57 +00:00
Andrey A. Chernov b431ceaa94 Add lv_LV, move lt_LT to common part 2009-09-03 16:53:11 +00:00
Edwin Groothuis 84dc44d825 Croatian locale support for hr_HR.ISO8859-2
Without this patch /usr/share/locale/hr_HR.ISO8859-2/LC_COLLATE
	is a link to the ../la_LN.ISO8859-2/LC_COLLATE. It means
	that there is no support for Croatian locale.

PR:		conf/120113
Submitted by:	Simun Mikecin <numisemis@yahoo.com>
MFC after:	1 week
2009-06-10 21:55:38 +00:00
Edwin Groothuis f8d7304fea add ca_AD, ca_FR and ca_IT locales
Catalan language is not only spoken in Spain (ca_ES), but also
    in Andorra, France and Italy. In Andorra it is the official
    language.

    (see http://en.wikipedia.org/wiki/Catalan_language#Geographic_distribution)

Add a bunch of symlinks to between ca_ES and ca_AD, ca_FR and ca_IT.

PR:		conf/92541
Submitted by:	<rmh@io.debian.net>
MFC after:	1 week
2009-06-10 12:20:11 +00:00
Dag-Erling Smørgrav 5373c6c718 According to a proposed Norwegian standard for alphabetization of which
I've obtained a draft, <u:> is indeed equivalent to u (to my surprise),
and <th> sorts immediately after z.

The correct ordering is algorithmic (based on the EOR) and can not be
accurately represented as a table.
2008-07-30 15:37:13 +00:00
Dag-Erling Smørgrav d3fbed0e09 Add collation sequence for no_NO. The same sequence applies to nb_NO
and nn_NO, which are symlinked to no_NO.

The patch in the PR contained a number of errors apparently based on
(sometimes incorrect) pronunciation; for instance, v and w are
distinct letters and should be collated in that order, even if they
are pronounced the same, while <u:> should be collated with u, even
though it is often mispronounced as y.  For lack of a solid reference,
I have taken sv_SE and simply changed the last three letters of the
alphabet.

PR:		conf/51920
MFC after:	2 weeks
2008-07-28 21:33:34 +00:00
Diomidis Spinellis 499f0f956d Fix collation order for accented characters.
MFC after:	2 weeks
2008-02-04 10:25:28 +00:00
Andrey A. Chernov aadebb995b Add reference to mnemonic char names 2007-12-25 21:21:26 +00:00
Andrey A. Chernov 280c5853dd Add Turkish collate
PR:             118976
Submitted by:   Ismail YENIGUL <ismail.yenigul@endersys.com.tr>
2007-12-24 10:30:09 +00:00
Andrey A. Chernov f2bd4453a8 Since SAOL 13:th edition "v" and "w" are officially separated (in 2006) 2007-11-19 12:39:02 +00:00
Dag-Erling Smørgrav a05bf06920 Add locales for nb_NO and nn_NO.
Reviewed by:	philip
2006-11-09 18:10:34 +00:00
Andrey A. Chernov 8a7dcaf4f9 Add mn_MN.UTF-8 2006-10-02 00:23:14 +00:00
Ruslan Ermilov 08f8440ba4 New Ukrainian locale: uk_UA.CP1251.
Submitted by:	Alexander Peresunko
2005-03-04 14:24:30 +00:00
Ruslan Ermilov 495eba5429 Utilize FILES and SYMLINKS, other simplifications. 2004-10-16 19:51:34 +00:00
Tim J. Robbins 1bbc832cce Add Basque (Spain) locales: eu_ES.ISO8859-1, eu_ES.ISO8859-15, eu_ES.UTF-8.
(This differs somewhat from the version originally submitted - any mistakes
are my own.)

PR:		68524
Submitted by:	J. Vicente Carrasco -Bixen-
2004-08-28 12:52:31 +00:00