# Titles of original works starting with an article are left-stripped (#4549)

**URL:** <https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17>\
**Category:** Bugs\
**Tags:** to-do, clustering\
**Created:** [September 20, 2021, 7:18pm UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17 "2021-09-20T19:18:02Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![oddrun](https://avatars.discourse-cdn.com/v4/letter/o/8797f3/32.png) [@oddrun](https://forum.svde.org/u/oddrun)\
**Post date:** [September 20, 2021, 7:18pm UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17/1 "2021-09-20T19:18:02Z")

</div>

Example:

1. Advanced search for person=Henrik Ibsen → 1 entry in result list, good!
2. Click on entry to show original works → Most of his original works were listed, I think (plus some aggregations, but that’s another matter), - also very good.  
However, beginning articles are stripped from the title:  
_Et dukkehjem_ is shown as _Dukkehjem_  
_De unges forbund_ is shown as _Unges forbund_  
The same bug appeared in v. 1.0, and I wonder if the source of the problem is the number of nonfiling characters encoded in the second indicator in title fields?

---

<div class="post-metadata">

**Author:** ![filipjakobsen](https://dub1.discourse-cdn.com/flex017/user_avatar/forum.svde.org/filipjakobsen/32/3_2.png) [@filipjakobsen](https://forum.svde.org/u/filipjakobsen)\
**Post date:** [September 20, 2021, 11:24pm UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17/2 "2021-09-20T23:24:10Z")

</div>

Thanks for testing and for your comment, @oddrun !

Let me look into this!

---

<div class="post-metadata">

**Author:** ![oddrun](https://avatars.discourse-cdn.com/v4/letter/o/8797f3/32.png) [@oddrun](https://forum.svde.org/u/oddrun)\
**Post date:** [September 21, 2021, 6:07am UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17/3 "2021-09-21T06:07:50Z")

</div>

Fine! I suspect this bug is a result of the bibliographic data processing, though, not the UI.

---

<div class="post-metadata">

**Author:** ![annadis](https://avatars.discourse-cdn.com/v4/letter/a/73ab20/32.png) [@annadis](https://forum.svde.org/u/annadis)\
**Post date:** [September 22, 2021, 9:31am UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17/4 "2021-09-22T09:31:34Z")

</div>

Hi,

@oddrun you’re right:

- there is a rule that strip the article from the title in all tags where the skip infiling is present (tags: 130/240/245/730/830/740)

- in particular, for the title _Et dukkehjem_ (present in the new SVDE), there are a lot of records with tag 240 where the title is entered without the article.

---

<div class="post-metadata">

**Author:** ![oddrun](https://avatars.discourse-cdn.com/v4/letter/o/8797f3/32.png) [@oddrun](https://forum.svde.org/u/oddrun)\
**Post date:** [September 22, 2021, 2:10pm UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17/5 "2021-09-22T14:10:49Z")

</div>

In my opinion, we must distinguish between which characters of a title are used in sorting/filing, and the actual title itself. For example, a title field like  
240 #3 $aEt dukkehjem  
doesn’t mean that the first 3 characters of the title should be _removed_, only that the first 3 characters should be ignored in sorting procedures, i.e. when finding its place in an alphabetical index or filing system. There, this title should appear in the ‘D’ part.  
However the (preferred) title is still Et dukkehjem, and should be rendered as such. I for one think it is very important to show the preferred titles of original works correctly.

---

<div class="post-metadata">

**Author:** ![annadis](https://avatars.discourse-cdn.com/v4/letter/a/73ab20/32.png) [@annadis](https://forum.svde.org/u/annadis)\
**Post date:** [September 23, 2021, 11:28am UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17/6 "2021-09-23T11:28:47Z")

</div>

Dear Oddrun, you’re right: the skip is used for the sorting of the titles.  
I try to better argue our decision to apply this rule.  
We process millions of records (bibliographic and authority) that come from different libraries, organizations and so on. Each one of them apply different cataloging practices.  
As I already affirmed, the title of the opus is coming from tag: 130/240/245/730/830/740, but also from $t of tag 1XX/7XX. So, we can have:  
• Bibliographic records where the title is in:

1. 240 00$aEt dukkehjem
2. 240 03$aEt dukkehjem
3. 240 10$aDukkehjem
4. 700 1 $aIbsen, Henrik,$d1828-1906$tDukkehjem

• Authority records where the title is in:  
5. 130 #0 $aDukkehjem  
6. 130 #0 $aEt Dukkehjem  
7. 130 #3 $aEt Dukkehjem  
8. ‎ 100 1# ‡aIbsen, Henrik‏ ‎‡d (1828-1906).‏‡tDukkehjem

Analyzing a large amount of record, we noticed that in most of them the article is not expressed in the related indicator for the skip (see case 1 and 6) and also it’s not reported in the title (see case 3 and 5).  
Moreover many opus titles come from $t in tag NT (1XX, 7XX), so in order to reconcile all entities, we decided to clusterize the title without article.

---

<div class="post-metadata">

**Author:** ![oddrun](https://avatars.discourse-cdn.com/v4/letter/o/8797f3/32.png) [@oddrun](https://forum.svde.org/u/oddrun)\
**Post date:** [September 24, 2021, 7:30am UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17/7 "2021-09-24T07:30:39Z")

</div>

I see (I think). So, if every reference (in all the incoming records) to this title had been “Et dukkehjem”, then you would have kept that title in svde also - including the article? Does this mean that it’s _not_ the eventual number in indicator 2 that causes the exclusion of articles, but the fact that some of the incoming data encode titles without a starting article?  
I think this is not quite satisfactory in the long run, and it will cause a lot of J.Cricketing… Giving precedence to the records from the country of the author (or the country of first publication) as source of title could solve some of it.

---

<div class="post-metadata">

**Author:** ![annadis](https://avatars.discourse-cdn.com/v4/letter/a/73ab20/32.png) [@annadis](https://forum.svde.org/u/annadis)\
**Post date:** [October 1, 2021, 11:27am UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17/8 "2021-10-01T11:27:05Z")

</div>

Dear Oddrun,  
I opened a development ticket to find a solution to this request. Please, in the meantime, can you send a list of norvegian stop words that we can use to improve our rules and algorithm?

---

<div class="post-metadata">

**Author:** ![oddrun](https://avatars.discourse-cdn.com/v4/letter/o/8797f3/32.png) [@oddrun](https://forum.svde.org/u/oddrun)\
**Post date:** [October 13, 2021, 6:00am UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17/9 "2021-10-13T06:00:28Z")

</div>

Hi, Here is a stopword list for Norwegian (bokmål and nynorsk): [Stopwords in Norwegian (by Snowball)](https://snowballstem.org/algorithms/norwegian/stop.txt)

---

<div class="post-metadata">

**Author:** ![annadis](https://avatars.discourse-cdn.com/v4/letter/a/73ab20/32.png) [@annadis](https://forum.svde.org/u/annadis)\
**Post date:** [October 13, 2021, 7:44am UTC](https://forum.svde.org/t/titles-of-original-works-starting-with-an-article-are-left-stripped-4549/17/10 "2021-10-13T07:44:03Z")

</div>

Thanks very much @oddrun .
