<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Verdana","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Hi Anne-Kathrin.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Re 1. To port existing alignments, you have two options:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">First, via “beads”. A. make sure that when you create your corpus, you have appropriate identifying s-attributes on your sentences. B. Second, create a “bead
file” which contains the alignment data. The format of this file is described in man cwb-align-import . Depending on what format your alignment data is in you might need to do some scripting to massage the data into the right format. Once you have this file,
use cwb-align-import to create the a-attribute.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Second, via a file containing the alignment, a “.align” file as created by cwb-align, and whose format is described in man cwb-align. The difference between
this and the previous is that in a beadfile aligned regions are indicated by identifying values from an s-attribute, whereas in this option, actual corpus position numbers must be used. Depending on the form your alignment data is in, this may be easier. A
“.align” is inserted into the index using cwb-align-<i>encode</i>.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">(note: since you’re on windows, you will find the man files as PDFs within a folder in the CWB installation location)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">The CWB tutorial chapter on alignment is currently half written and thus absent from the version on the website. I attach a build of the PDF I’ve just made,
which contains further info on all the above.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Re 2. See <a href="http://cwb.sourceforge.net/faq.php?hoist=windows_terminal#windows_terminal">http://cwb.sourceforge.net/faq.php?hoist=windows_terminal#windows_terminal</a>
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">best<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Andrew.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> cwb-bounces@sslmit.unibo.it [mailto:cwb-bounces@sslmit.unibo.it]
<b>On Behalf Of </b>Anne Schumann<br>
<b>Sent:</b> 08 April 2016 08:19<br>
<b>To:</b> cwb@sslmit.unibo.it<br>
<b>Subject:</b> [CWB] parallel German and English corpus encoding<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Dear CQP experts,<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I would like to set up a parallel German and English corpus and I have two related questions:<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">1. I understand that the main difficulty here is to align the corpus. Is it possible to port existing alignments (e.g. a translation memory or outputs of other tools) to CWB? So far, I have managed to align
and encode a mere 7 sentences with cwb-align and related tools. Beyond that, the difficulty of obtaining the exact same number of sentences on both sides from my sentence splitter made it very hard for me to encode the corpus. Any hints or best practices?<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">2. Maybe this is a naive question and not entirely related to CWB: Is there a way to handle German characters (ä and the like) properly on the console, that is, to ensure that they can be searched for and displayed
properly? Actually, my registry file tells me that "charset = 'utf8'", but searching for Umlauts etc. triggers an error: "Query includes a character ... that is invalid in the encoding specified for this corpus." At the moment, I work on Windows.<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Thanks in advance for your advice.<o:p></o:p></p>
</div>
<p class="MsoNormal">All the best,<o:p></o:p></p>
</div>
<p class="MsoNormal">Anne-Kathrin Schumann<o:p></o:p></p>
</div>
</div>
</body>
</html>